...
Parameter | Value |
---|---|
spark.eventLog.enabled | This should be set to true . |
spark.eventLog.dir | Set <DAS_HOME>/work as the location to save the logs. |
Monitoring via Spark UIs
Note |
---|
Spark UIs display information such as user IDs and keystore passwords. If you do not want to expose such information, it is recommended to disable these UIs. |
Apache Spark provides a set of user interfaces (UI) that allow you to monitor and troubleshoot the issues in a Spark cluster. This section helps you to understand the information accessed from these UIs.
...