The Apache Kafka event receiver reads the tail of a given file and inputs that to the WSO2 product engine. This feature is donated by Andres Gomez Ferrer. For more information, go to Apache Kafka documentation.
...
- Download Apache Kafka server.
Copy the following client JAR files from
<KAFKA_HOME>/lib/directory to<PRODUCT_HOME>/repository/components/lib/directory.kafka_2.10-0.8.1.jar
zkclient-0.3.jar
scala-library-2.10.1.jar
zookeeper-3.3.4.jar
kafka-clients-0.8.2.1
metrics-core-2.2.0
Info The above jars are the client jars for Kafka 2.10-0.8.1. If you want to use the client jars for Kafka_2.10-0.9.0.1 or Kafka_2.11-0.9.0.1, the following needs to be done.
- Copy the following client JAR files from
<KAFKA_HOME>/lib/directory to<PRODUCT_HOME>/repository/components/lib/directory.kafka_2.11-0.9.0.1.jarkafka-clients-0.9.0.1.jarmetrics-core-2.2.0.jarscala-library-2.11.7.jarscala-parser-combinators_2.11-1.0.4.jarzkclient-0.7.jarzookeeper-3.4.6.jar
- Download the jass.conf file and save it in the
<DAS_HOME>/repository/conf/securitydirectory.
- Start the Apache Kafka server.
...
Adapter Property | Description | Configuration file property | Example |
|---|---|---|---|
Server Zookeeper IP | IP address of the Zookeeper Server | zookeeper.connect | 127.0.0.1 |
Group ID Kafka | Kafka consumer group id which uniquely identifies a set of consumers within the same consumer group | group.id | groupid |
Threads | Number of consumer threads | threads | 4 |
| Optional Configuration Properties | Valid property and value pairs to denote o ptional configuration properties for Apache Kafka. (E.g. "property1: value1, property2: value2") For more information on Axis2 JMS properties, go to Apache Kafka Documentation. | optional.configuration | zk.sessiontimeout.ms:6000 |
| Topic Kafka | Name of the Kafka topic to which, input messages are published | topic | test_topic |
| Is events duplicated in cluster | In a cluster whether the same event can reach two receiver nodes | events.duplicated.in.cluster | true/false |
...