The Apache Kafka event receiver reads the tail of a given file and inputs that to the WSO2 product engine. This feature is donated by Andres Gomez Ferrer . For more information, go to Apache Kafka documentation.
...
- Download Apache Kafka server.
- Copy the following client JAR files from
<KAFKA_HOME>/lib/directory to<PRODUCT_HOME>/repository/components/lib/directory.kafka_2.10-0.8.1.jar
zkclient-0.3.jar
scala-library-2.10.1.jar
zookeeper-3.3.4.jar
kafka-clients-0.8.2.1
metrics-core-2.2.0
Info Kafka_2.10-0.9.0.1 is backward compatible. Therefore, you can use Kafka_2.10-0.8.2.1 client jars to connect with Kafka_2.10-0.9.0.1.
Info If you are using Kafka_2.11-0.10.0.0, you need to download this jar and save it in the
<PRODUCT_HOME>/repository/components/lib/directory. - Start the Apache Kafka server.
...
Adapter Property | Description | Configuration file property | Example |
|---|---|---|---|
Server Zookeeper IP | IP address of the Zookeeper Server | zookeeper.connect | 127.0.0.1 |
Group ID Kafka | Kafka consumer group id which uniquely identifies a set of consumers within the same consumer group | group.id | groupid |
Threads | Number of consumer threads | threads | 4 |
| Optional Configuration Properties | Valid property and value pairs to denote o ptional configuration properties for Apache Kafka. (E.g. "property1: value1, property2: value2") For more information on Axis2 JMS properties, go to Apache Kafka Documentation. | optional.configuration | zk.sessiontimeout.ms:6000 |
| Topic Kafka | Name of the Kafka topic to which, input messages are published | topic | test_topic |
| Is events duplicated in cluster | In a cluster whether the same event can reach two receiver nodes | events.duplicated.in.cluster | true/false |
...