...
- 3 DAS nodes (variable roles: publisher, receiver, analyzer and indexer): c4.2xlarge
- 1 HBase master + and Hadoop Namenode: c3.2xlarge
- 9 HBase Regionservers + and Hadoop Datanodes: c3.2xlarge
...
This test was designed to test the data layer during sustained event publication. During testing, the TPS was around the 150K mark, and the memstore flush of the HBase cluster 's memstore flush (which suspends all writes) and minor compaction operations brought it down somewhat in bursts. Overall, a mean of 96K TPS was achieved, but a steady rate of around 100-150K TPS as is achievable, as opposed to the current no-flow-control situation.
The published data took around 950GB on the Hadoop filesystem, taking the HDFS-level replication into account.
| Events | 1000000000 |
| Time (sin seconds) | 10391.768 |
| Mean TPS | 96230.01591 |
...