VOOZH about

URL: https://sematext.com/docs/logagent/input-plugin-kafka/

⇱ Logagent input plugin for Apache Kafka - Sematext Documentation


Skip to content

Apache Kafka input

Input Plugin: Apache Kafka

Input plugin for @sematext/logagent. The plugin acts as message consumer for Apache Kafka.

Installation

Install @sematext/logagent and logagent-input-kafka npm package:

npm i -g @sematext/logagent 
npm i -g logagent-input-kafka

Configuration

# Global options
options:
 includeOriginalLine: false
input:
 kafka: 
 module: logagent-input-kafka
 host: localhost
 port: 9092
 groupId: ExampleTestGroup
 topic: test
 autoCommit: true
 sessionTimeout: 15000
 sslEnable: false
 #For init sslOptions please refer to to https://nodejs.org/api/tls.html
 sslOptions: 
 - rejectUnauthorized: false
output:
 stdout: yaml # use 'pretty' for pretty json and 'ldjson' for line delimited json (default)
 elasticsearch: 
 module: elasticsearch
 url: http://localhost:9200
 index: test

Start logagent

logagent --config logagent-kafka-input.yaml