Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Data Agents are external sources that publish data to WSO2 DAS. Data Agent components reside in external systems and pushes push data as events to the DAS. For more information on Data Agents, see /wiki/spaces/PS/pages/10519883.

...

Analytics REST API

In addition to the Event Receivers, WSO2 DAS facilitates REST API based data publishing. You can use the REST API with Web applications and Web services. For more information on REST API, see Analytics REST API Guide.

Anchor
Data Store
Data Store
Data Store

WSO2 DAS supports Data Stores (Cassandra, HBase, and RDBMS etc.for data persistence. There are three main types of Data Stores, namely Event Store, Processed Event Store, and File store. Event Store is used to store events that are published directly to the DAS. Processed Event Store is used to store resulting data processed using Apache Spark analytics. File store is used for storing Apache Lucene indexes. For more information on Data Stores, see DAS Data Access Layer.

Analytics Spark

Main analytics engine of WSO2 DAS is based on Apache Spark. This is

Anchor
Siddhi Event Processors
Siddhi Event Processors
Siddhi Event Processors

WSO2 DAS uses a realtime event processing engine which is based on Siddhi. For more information on realtime analytics using Siddhi, see Realtime Analytics Using Siddhi .

Analytics Spark

Apache Spark is used to perform batch analytics operations on the data stored in Event Stores using analytics scripts written in Spark SQL. For more information on Spark analytics, see Batch Analytics Using Spark SQL.

Data Indexing

Data Indexing is a periodically running process which updates the Lucene indexes for the indexed fields in the Event Store configurations of an event stream.

Anchor

...

Event

...

WSO2 DAS uses a realtime event processing engine which is based on Siddhi. For more information on realtime analytics using Siddhi, see Realtime Analytics Using Siddhi .

Anchor
Event Publishers
Event Publishers
Event Publishers

Output data either from Spark scripts or the Siddhi CEP engine are published from the DAS using event publishers. Event Processors Publishers support various transport protocols. For more information on Event Publishers, see Creating Alerts.

...