...
Spark queries from the Smart Home DAS sample were executed against the published data, and the analyzer node count was kept at 2 and 3 respectively for 2 separate tests. 6 . The SPARK JVMs were provided with following during the test.
- 1.36 processor cores
...
- 12GB
...
- of dedicated memory
The following results were observed.
- Over 1 million TPS on Spark for 2 analyzers
...
- About 1.3 million TPS for 3
...
- analysers.
DAS read operations from the HBase cluster also leverage HBase data locality, which would have made the read process more efficient compared to random reads.
...
The setup is a 2 node analyzer cluster with a MySQL database as the event store. Analyzer statistics (i.e., the time duration for each execution of the query) are given below.
...