What is new in this release
The WSO2 DAS version 3.0.0 is the successor of WSO2 BAM, and it is a complete rewrite of the analytics solution based on the latest technologies. It contains the following new features and enhancements.
- Data abstraction layer for analytics
- Apache Spark SQL-based analytics query execution
- Data publisher rewrite
- RDBMS datasource support
- REST APIs for analytics data service
- CLI like user interface for Spark integrationIntroduction of the Data Access Layer to persist data for batch analytics
- Improved query execution with Apache Spark.
- Introduction of the Batch Analytics Console which provides a CLI like user interface for Spark integration.
- Allows event streams to be configured as either real time streams or persistent streams, enabling you to use DAS for both real time and batch analytics.
- Introduction of event receivers. An event receiver in DAS 3.0.0 provides the combined functionality of an input event adapter and an event builder in BAM 2.x.x. A range of event receiver types are supported instead of input event adapter types.
- Supports receiving events via MQTT (i.e. using MQTT receiver type).
- Introduction of event publishers. An event publisher in DAS 3.0.0 provides the combined functionality of an output event adapter and an event formatter in BAM 2.x.x. A range of event publisher types are supported instead of output event adapter types.
- Supports publishing events via MQTT (i.e. using MQTT publisher type).
- The Siddhi Query Language has been re-architectured. The changes include the following:
- Improved execution of events with threaded architecture
- Improved partitioning capabilities
- Scheduled event triggering with quartz-scheduler cron expressions
- Event table support for Oracle databases
- Introduction of new extensions
For the updated version, see Siddhi Query Language.
- Supports a new indexing mechanism with Apache Lucene. This allows you to specify data to be indexed at the time of persisting data, and facilitates searching via the UI as well as via Lucene queries. For further information, see Searching Data By Categories.
- Supports predictive analytics by integrating with WSO2 Machine Learner.
- Introduction of the Analytics Dashboard for improved communication of results. This dashboard analyses data received from both real time and persistent event streams, and displays the results of the analysis in a meaningful manner.
- Ability to configure properties for event receivers and event publishers at a global level.
- Introduction of RDBMS datasource support.
- Allows REST APIs to be used for analytics data service.
- Supports deployment of artifacts using C-Apps.
Compatible WSO2 product versions
You can make any WSO2 product compatible with WSO2 DAS after installing a data agent. Data agents allow the product to communicate with the DAS and send statistics for analysis. The following products have the latest compatible data agents in them by default, and therefore are compatible with DAS 3.0.0.
- APIM 1.9.1
- AS 5.3.0
- ESB 4.89.1 0
If a particular product version you are using does not have a data agent installed, follow the steps below to install one:
- Check the WSO2 Release Matrix and identify the WSO2 Carbon version that your product is based on.
- Go to WSO2 P2 repositories and select the repository that is based on the Carbon version you selected in the previous step.
- Add the feature repository to your product.
- Then, select the data agent that you need from the features in the repository, and install it in your product. For example, in order to send mediation statistics from WSO2 ESB to DAS, you must install
Mediation Statistics Data Agent
feature.
For information on the third-party software required with DAS 3.0.0, see Installation Prerequisites.
DeprecatedReplaced BAM features
WSO2 DAS contains the following major new technological changes/substitutions when compared to its predecessor, which is WSO2 BAM.
- Introduction of a WSO2 BAM only allows Cassandra to be used as the event store. WSO2 DAS supports a generic data store that can mount RDBMS, HBase, Cassandra or any other data store, instead of supporting Cassandra as the one and only event store.
- Replaced Hadoop with Apache Spark, and Hive with Spark SQL.
- Introduced a new Indexing mechanism using Apache Lucene. This replaces the Cassandra based indexing mechanism used in WSO2 BAM.
- Replaced the Gadget Server and Gadget generating tool with WSO2 UES-based dashboards and its .
- WSO2 BAM uses ApacheHadoop for batch analytics. WSO2 DAS uses Apache Spark for the same.
- WSO2 BAM supports its search functionality with Cassandra based indexing whereas WSO2 DAS uses a Lucene based indexing mechanism.
- WSO2 BAM generates dashboards and gadgets using the WSO2 Gadget Server and the Gadget Generating Tool. WSO2 DAS uses WSO2 UES based dashboards and a new gadget generating tool.
- Integration of WSO2 CEP 4.0.0 based features, instead of WSO2 CEP 3.x.
- Introduced CAR file-based artifact deployment to replace WSO2 BAM toolbox support.
- Removed WSO2 BAM report generation.WSO2 BAM integrates with WSO2 CEP 3.x.x versions for real time analytics, whereas WSO2 DAS integrates with WSO2 CEP 4.0.0.
- WSO2 BAM uses BAM Toolbox for artifact deployment. WSO2 DAS uses C-Apps for the same purpose.
Deprecated BAM features
- Report generation
Fixed issues
For a list of fixed issues in this release, see WSO2 DAS 3.0.0 - Fixed Issues.
Known issues
For a list of known issues in this release, see WSO2 DAS 3.0.0 - Known Issues.