Versions Compared

Old Version 3

changes.mady.by.user Former user

Saved on

compared with

New Version 4

changes.mady.by.user Former user

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

The Apache Kafka event receiver reads the tail of a given file and inputs that to the WSO2 product engine. This feature is donated by Andres Gomez Ferrer. For more information, go to Apache Kafka documentation.

...

  1. Download Apache Kafka server. 

  2. Copy the following client JAR files from <KAFKA_HOME>/lib/ directory  to <PRODUCT_HOME>/repository/components/lib/ directory.

    • kafka_2.10-0.8.1.jar
    • zkclient-0.3.jar
    • scala-library-2.10.1.jar
    • zookeeper-3.3.4.jar
    • kafka-clients-0.8.2.1
    • metrics-core-2.2.0
    Start the Apache Kafka server.
     Info
    The above jars are the client jars for Kafka 2.10-0.8.1. If you want to use the client jars for Kafka_2.10-0.9.0.1 
...
  1. or Kafka_2.11-0.9.0.1, the following needs to be done.
    1. Copy the following client JAR files from <KAFKA_HOME>/lib/ directory  to <PRODUCT_HOME>/repository/components/lib/ directory.
      • kafka_2.11-0.9.0.1.jar
      • kafka-clients-0.9.0.1.jar
      • metrics-core-2.2.0.jar
      • scala-library-2.11.7.jar
      • scala-parser-combinators_2.11-1.0.4.jar
      • zkclient-0.7.jar
      • zookeeper-3.4.6.jar
    2. Download the jass.conf file and save it in the <DAS_HOME>/repository/conf/security directory.
  2. Start the Apache Kafka server.
Creating an Kafka  event receiver 
...
Adapter Property
Description
Configuration file propertyExample
 Server Zookeeper IP 
 IP address of the Zookeeper Server 
zookeeper.connect
127.0.0.1
 Group ID Kafka 
 Kafka consumer group id which uniquely identifies a set of consumers within the same consumer group 
 
group.id
groupid
 Threads 
 Number of consumer threads 
threads
4
 Optional Configuration Properties 
Valid property and value pairs to denote o ptional configuration properties for  Apache Kafka.  (E.g. "property1: value1, property2: value2")
For more information on Axis2 JMS properties, go to Apache Kafka Documentation.
optional.configurationzk.sessiontimeout.ms:6000
 Topic Kafka Name of the Kafka topic to which, input messages are published
topic
test_topic
 Is events duplicated in cluster In a cluster whether the same event can reach two receiver nodes
events.duplicated.in.cluster
true/false
...