Page Comparison

Kafka event publisher is used to send events in xml,text, and JSON formats to a specific Web service location using POST. This feature is donated by Andres Gomez Ferrer. For more information on Apache Kafka, go to Apache Kafka documentation.

Table of Contents

maxLevel	3

Prerequisites

Set up the below prerequisites to start configuring an Apache Kafka event publisher.

Download Apache Kafka server.
Copy the following client JAR files from <KAFKA_HOME>/lib/ directory to <PRODUCT_HOME>/repository/components/lib/ directory.
- ```
kafka_2.10-0.8.1.jar
```
- ```
zkclient-0.3.jar
```
- ```
scala-library-2.10.1.jar
```
- ```
zookeeper-3.3.4.jar
```
- ```
kafka-clients-0.8.2.1
```
- ```
metrics-core-2.2.0
```

Creating a Kafka event publisher

For instructions on creating a Kafka event publisher, see Publishing Events Creating Alerts.

Configuring adapter properties

Specify the Static and Dynamic Adapter Properties, when creating a Kafka JMS event publisher using the management console as shown below.

Apache Kafka publisher

Info
After entering the above adapter properties, select the the Message Format which you want to apply on the published events . Also, click Advanced to to define custom output mappings based on the Message Format you you selected. For more information on custom output mapping types, see Publishing Events in Various Event Formats see Output Mapping Types.

You can also d efine the respective adapter properties of the event publisher based on the transport type within the <to> element of the event publisher configuration in the <PRODUCT_HOME>/repository/deployment/server/eventpublishers/ directory as follows.

Code Block

language	xml

<eventPublisher name="KafkaOutputEventAdapter" statistics="disable" trace="disable" xmlns="http://wso2.org/carbon/eventpublisher">
  ....................
  <to eventAdapterType="kafka">
    <property name="topic">test_topic</property>
    <property name="optional.configuration">{property_name1:property_value1, property_name2:property_value2}</property>
    <property name="meta.broker.list">{host1:port1,host2:port2}</property>
  </to>
</eventPublisher>

The above adapter properties are described below.

Static adapter properties

Adapter Property	Description	Configuration file property	Example
Meta Broker List	This is for bootstrapping and the producer will only use it for getting metadata. The list can be a subset of brokers.	meta.broker.list	{host1:port1,host2:port2}
Optional Configuration Properties	Define optional configuration properties	optional.configuration	{property_name1:property_value1, property_name2:property_value2}

Dynamic adapter properties

Adapter Property	Possible Values	Description	Configuration file property	Example
Topic	sensorStream	Name of the Kafka topic to which, input messages are published	topic	test_topic

Versions Compared

Old Version 2

New Version 3

Key

Prerequisites

Creating a Kafka event publisher

Configuring adapter properties

Static adapter properties

Dynamic adapter properties