This section is still a work in progress.
The embedded Spark server in WSO2 ESB Analytics Server can be used in several deployment modes, depending on your requirement.
Mode | Description | When to use |
---|---|---|
Local (default) | In this mode, all of the Spark related work is done within a single node/JVM. | This is ideally suited for evaluation purposes and testing Spark queries in ESB Analytics. |
Cluster (recommended) | ESB Analytics creates its own Spark cluster in the Carbon environment (using Hazelcast). This mode can be used with several high availability (HA) clustering patterns to handle failover scenarios. Additionally, in the Cluster mode, ESB Analytics can be setup without a Spark application. This allows other components to use the ESB Analytics cluster as an external Spark cluster. | For clustered production setups. |
Client | In this mode, ESB Analytics acts only as a Spark client pointing to a separate Spark master. | This is suited to scenarios where you want to submit ESB analytics jobs to an external Spark cluster. |
The following topics list out the configuration instructions for the different deployment modes and also provide instructions on disabling Spark applications.