Apache Kafka Integration

The Apache Kafka Connector enables HMF4J to interface with Apache Kafka messaging system. To use this connector import the following dependency along with the other HMF4J libraries to the pom file.

<dependency>
  <groupId>io.github.handy-messaging-framework</groupId>
  <artifactId>hmf4j-kafka-connector</artifactId>
  <version>1.1.0</version>
</dependency>

The system parameter in the configuration profile should be kafka. The consumer and producer properties in the configuration file should be any valid Apache Kafka properties. More details on these properties can be read here. For the consumer the 2 mandatory properties required by the HMF4J framework are max.messages.per.batch and max.poll.duration.millis.

A sample of the configuration file for Apache Kafka system looks like below:

hmf4j:
 profiles:
  - profileName: kafka_profile
    system: kafka
    consumer:
      properties:
        bootstrap.servers: localhost:9092
        group.id: test_app
        max.messages.per.batch: 3
        max.poll.duration.millis: 10000
    producer:
      properties:
        bootstrap.servers: localhost:9092