Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Reverted from v. 10

What is new in this release 

The WSO2 DAS version 3.0.0 is the successor of first version of WSO2 BAMDAS, and it which is a complete rewrite of the analytics solution based on the latest technologies. It contains the following new features and enhancements.

  • Introduction of the Data Access Layer to persist data for batch analytics
  • Improved query execution with Apache Spark.
  • Introduction of the Batch Analytics Console which provides a Data abstraction layer for analytics
  • Apache Spark SQL-based analytics query execution
  • Data publisher rewrite
  • RDBMS datasource support
  • REST APIs for analytics data service
  • CLI like user interface for Spark integration.
  • Allows event streams to be configured as either real time streams or persistent streams, enabling you to use DAS for both real time and batch analytics.
  • Introduction of event receivers. An event receiver in DAS 3.0.0 provides the combined functionality of an input event adapter and an event builder in BAM 2.x.x. A range of event receiver types are supported instead of input event adapter types.
  • Supports receiving events via MQTT (i.e. using MQTT receiver type).
  • Introduction of event publishers. An event publisher in DAS 3.0.0 provides the combined functionality of an output event adapter and an event formatter in BAM 2.x.x. A range of event publisher types are supported instead of output event adapter types.
  • Supports publishing events via MQTT (i.e. using MQTT publisher type).
  • The Siddhi Query Language has been re-architectured. The changes include the following:
    • Improved execution of events with threaded architecture
    • Improved partitioning capabilities
    • Scheduled event triggering with quartz-scheduler cron expressions
    • Event table support for Oracle databases
    • Introduction of new extensions

For the updated version, see Siddhi Query Language.

  • Supports a new indexing mechanism with Apache Lucene. This allows you to specify data to be indexed at the time of persisting data, and facilitates searching via the UI as well as via Lucene queries. For further information, see Searching Data By Categories.
  • Supports predictive analytics by integrating with WSO2 Machine Learner.
  • Introduction of the Analytics Dashboard for improved communication of results. This dashboard analyses data received from both real time and persistent event streams, and displays the results of the analysis in a meaningful manner.
  • Ability to configure properties for event receivers and event publishers at a global level. 
  • Introduction of RDBMS datasource support.
  • Allows REST APIs to be used for analytics data service.
  • Supports deployment of artifacts using C-Apps.

Also, WSO2 DAS contains the following major new technological changes/substitutions when compared to its predecessor, which is WSO2 BAM. 

  • Introduction of a generic data store that can mount RDBMS, HBase, Cassandra or any other data store, instead of supporting Cassandra as the one and only event store.
  • Replaced Hadoop by Apache Spark, and Hive by Spark SQL.
  • Introduced indexing on stream persistence using Apache Solr, instead of the Casandra secondary and custom index based indexing.
  • Replaced the Gadget Server and Gadget generating tool with WSO2 UES-based dashboards and its new gadget generating tool.
  • Integration of WSO2 CEP 4.0.0 based features, instead of WSO2 CEP 3.x.
  • Introduced CAR file-based artifact deployment for WSO2 BAM toolbox support.
  • Removed WSO2 BAM report generation.

Compatible WSO2 product versions 

You can make any WSO2 product compatible with WSO2 DAS after installing a data agent. Data agents allow the product to communicate with the DAS and send statistics for analysis. The following products have the latest compatible data agents in them by default, and therefore are compatible with DAS 3.0.0.

  • APIM 1.98.
  • AS 5.32.01
  • ESB 4.9.0   .8.1  
  • ELB 2.1.1

If a particular product version you are using does not have a data agent installed, follow the steps below to install one:

  1. Check the WSO2 Release Matrix and identify the WSO2 Carbon version that your product is based on.
  2. Go to WSO2 P2 repositories and select the repository that is based on the Carbon version you selected in the previous step.
  3. Add the feature repository to your product. 
  4. Then, select the data agent that you need from the features in the repository, and install it in your product. For example, in order to send mediation statistics from WSO2 ESB to DAS, you must install Mediation Statistics Data Agent feature.

For information on the third-party software required with DAS 3.0.0, see Installation Prerequisites.

Replaced BAM features

WSO2 DAS contains the following major new technological changes/substitutions when compared to its predecessor, which is WSO2 BAM. 

  • WSO2 BAM only allows Cassandra to be used as the event store. WSO2 DAS supports a generic data store that can mount RDBMS, HBase, Cassandra or any other data store.
  • WSO2 BAM uses ApacheHadoop for batch analytics. WSO2 DAS uses Apache Spark for the same.
  • WSO2 BAM supports its search functionality with Cassandra based indexing whereas WSO2 DAS uses a Lucene based indexing mechanism.
  • WSO2 BAM generates dashboards and gadgets using the WSO2 Gadget Server and the Gadget Generating Tool. WSO2 DAS uses WSO2 UES based dashboards and a new gadget generating tool

    .

  • WSO2 BAM integrates with WSO2 CEP 3.x.x versions for real time analytics, whereas WSO2 DAS integrates with WSO2 CEP 4.0.0.
  • WSO2 BAM uses BAM Toolbox for artifact deployment. WSO2 DAS uses C-Apps for the same purpose.
  • Deprecated

    BAM

    features

    Report generation

    Fixed issues

    For a list of fixed issues in this release, see WSO2 DAS 3.0.0 - Fixed Issues.

    Known issues

    For a list of known issues in this release, see WSO2 DAS 3.0.0 - Known Issues.