The embedded Spark server in WSO2 EI Analytics Server can be used in several deployment modes, depending on your requirement.
| Mode | Description | When to use |
|---|---|---|
| Local (default) | In this mode, all of the Spark related work is done within a single node/JVM. | This is ideally suited for evaluation purposes and testing Spark queries in EI Analytics. |
| Cluster (recommended) | EI Analytics creates its own Spark cluster in the Carbon environment (using Hazelcast). This mode can be used with several high availability (HA) clustering patterns to handle failover scenarios. Additionally, in the Cluster mode, EI Analytics can be setup without a Spark application. This allows other components to use the EI Analytics cluster as an external Spark cluster. | For clustered production setups. |
| Client | In this mode, EI Analytics acts only as a Spark client pointing to a separate Spark master. | This is suited to scenarios where you want to submit EI analytics jobs to an external Spark cluster. |
The following topics list out the configuration instructions for the different deployment modes and also provide instructions on disabling Spark applications.
| Table of Contents |
|---|
...
| maxLevel | 3 |
|---|---|
| minLevel | 3 |
Local mode
This is the default mode for a typical EI Analytics instance. This mode enables users to evaluate Spark analytics in the EI Analytics Server. In this mode, a separate master or worker is not spawned. Instead, everything would run on a single JVM. Therefore, certain options like Spark Master UI and Spark Worker UI are not active.
...