com.atlassian.confluence.content.render.xhtml.migration.exceptions.UnknownMacroMigrationException: The macro 'next_previous_links' is unknown.

Monitoring Cluster Statistics

When you have a Cassandra cluster with SS embedded Cassandra as the Cassandra nodes, you can monitor cluster statistics using the management console of the provisioning Storage Server. 

Before you begin, ensure that all the nodes of the cluster are configured in the cluster-config.xml file stored in the <SS_HOME>/repository/conf/etc/ directory as explained here.

You may have multiple SS embedded Cassandra clusters in multiple environments of your system. Please note that the cluster-config.xml file should be updated in one SS node of each Cassandra cluster.

 

The following instructions explain how to monitor node statistics:
  1. Log in to the WSO2 Storage Server management console.
  2. Go to the and Monitor menu and click Cassandra Stats. The Cluster Ring screen opens showing cluster-wide, keyspace-level and column-family-level statistics, such as gossip info, column family histograms etc.
    The elements of this table are described below.

    ElementDescription
    NodeNode IP
    StateCurrent state of the node (Normal/Leaving/Joining/Moving)
    Data CenterData Center which this node belongs to
    RackRack which this node belongs to
    StatusCurrent status of the node (Up/Down)
    LoadUsed disk storage
    TokenToken of the node
    OwnershipHow much (%) data in the cluster is owned by this node
  3. Click Node to access its node-level statistics. The Node Stats screen opens as follows:

Different types of statistics on the cluster node can be accessed by clicking on each of the following links:

Node Info

An example of the Node Info screen is shows below.

The following table describes information shown in the above window.

General Properties:

ElementDescription
TokenToken of the node
GossipStateGossip is enabled or not
LoadUsed disk storage
Generation NoTimes started
Up time(Seconds)Server up time
Head Memory Usage(MB)Head Memory Usage (MB)
Data centerData Center which this node belongs to
RackRack which this node belongs to
Exception CountException Count

CF Stats

Shows the column family information. For example,

The following table describes information shown in the above window.

Keyspace Information:

ElementDescription
Read CountNumber of read requests received since server startup
Read Latency(ms)total time spent for read requests since server started divided by number of read requests since server started 
Write CountNumber of write requests received since server startup
Write Latency (ms)total time spent for write requests since server started divided by number of write requests since server started
Pending TasksTasks in the queue for reads, writes, and cluster operations of tables in the keyspace.

Column Family Information:

ElementDescription
SS Table CountNumber of SSTables containing data from the table
Space Used(live)Total size of all live SS tables
Space Used(total)Total size of all SS tables
Number of Keys (estimate)NUmber of keys in the node
Memtable Column CountColumn Count in Memtable
Memtable Data SizeData Size in Memtable
Memtable Switch CountHow many times a "full" memtable was swapped for an empty one
Read CountNumber of read requests received since server startup
Read Latency(ms)total time spent for read requests since last call to jmx mbean divided by number of read requests since last call to jmx mbean
Write CountNumber of write requests received since server startup
Write Latency(ms)total time spent for write requests since last call to jmx mbean divided by number of write requests since last call to jmx mbean
Pending TasksApproximate number of pending tasks thread pool has.
Bloom Filter False Positives

Number of false positives, which occur when the bloom filter said the row existed, but it actually did not exist in absolute numbers

Bloom Filter False RatioFraction of all bloom filter checks resulting in a false positive
Bloom Filter Space UsedBytes of bloom filter data
Compacted Row Minimum SizeLower size limit in MB for table rows being compacted in memory
Compacted Row Maximum SizeUpper size limit in bytes for compacted table rows, configurable in the cassandra.yaml (in_memory_compaction _limit_in_mb)
Compacted Row Mean SizeThe average size in bytes of compacted table rows

Version

Shows the Cassandra Server version in a pop-up dialog box as follows:

Thread Pool Stats

Shows the thread pool statistics available for a node. Given below are descriptions of the information shown under general and dropped properties.

ElementDescription
ReadStage 
RequestResponseStage 
ReadRepairStage 
MutationStage 
ReplicateOnWriteStage 
GossipStage 
AntiEntropyStage 
MigrationStage 
StreamStage 
MemtablePostFlusher 
FlushWriter 
MiscStage 
commitlog_archiver 
InternalResponseStage 
HintedHandoff 

Message TypeDescription
RANGE_SLICE 
READ_REPAIR 
BINARY 
READ 
MUTATION 
REQUEST_RESPONSE 

Compaction Stats 

Shows the compaction statistics of the node as shown in the following example.

ElementDescription
Pending TasksHow many pending compaction tasks are pending
Active Remaining TimeHow much time remaining to complete compact tasks

Gossip Info 

Shows statistics of the Gossip server as shown in the following example.


Network Stats 


Range Key

Click Keyspace Stats in the Node Stats screen to view statistics of the key spaces and associated column families.

Keyspace Statistics

Shows the available keyspaces with operations as depicted in the example below.


It shows the following statistics for each keyspace.

OperationDescription
Ownership 
Describe Ring 

Click on a selected keyspace to view its column-family statistics.

Column Family Statistics

Click on the selected keyspace to open the column family statistics associated with it. The Column Family Stats screen opens. For example,

The table below gives information of each type of statistical data that can be viewed by clicking on each link on the screen.

Stats TypeDescription
Histogram 
EndpointsShows which node has a given key
SSTablesShows which SS table has a given key
Compaction Thresholds 
com.atlassian.confluence.content.render.xhtml.migration.exceptions.UnknownMacroMigrationException: The macro 'next_previous_links2' is unknown.