Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

This tab displays detailed information about the SQL queries of the selected Spark application.


Spark issues in a production envirionment

The following are three issues that may occur when you work with Spark in a multi node DAS cluster:

  • The DAS nodes consuming too much CPU processing power.
  • DAS nodes running out of memory.
  • Too many log directories being created in the <DAS_HOME>/work directory.

All of the above issues can be created as a result of he symbolic link not being correctly resolved in these operating system. To address this, you are required to update the <DAS_HOME>/bin/wso2server.sh file with the following entry so that the <DAS_HOME> is exported. 

Export CARBON_HOME=<symbolic link