VOOZH about

URL: https://dzone.com/articles/consumer-group-in-kafka-video-tutorials-partitions

⇱ Consumer Group in Kafka [Video Tutorials]


Related

  1. DZone
  2. Data Engineering
  3. Big Data
  4. Consumer Group in Kafka [Video Tutorials]: Partitions and Consumers

Consumer Group in Kafka [Video Tutorials]: Partitions and Consumers

In this video tutorial series, take a deeper look at the consumer group in Kafka with varying numbers of partitions and consumers.

By Apr. 21, 23 · Tutorial
Likes
Comment
Save
6.1K Views

Join the DZone community and get the full member experience.

Join For Free

In this video tutorial series, take a deeper look at the consumer group in Kafka with:

  • 1 partition and 2 consumers
  • 2 partitions and 2 consumers
  • 3 partitions and 1 consumer

Consumer Group in Kafka With 1 Partition and 2 Consumers

In this first Apache Kafka tutorial, learn about Java Kafka consumer code with 1 partition and 2 consumers.

  • Both consumers are registered to the same consumer group.
  • One consumer will be sitting idle.
  • The same partition cannot be assigned to multiple consumers in the same group.

Let's begin!


Consumer Group in Kafka With 2 Partitions and 2 Consumers

The following tutorial explains the Kafka consumer group with 2 partitions and 2 consumers.

  • Both consumers are registered to the same consumer group.
  • The same partition cannot be assigned to multiple consumers in the same group.

Consumer Group in Kafka with 3 Partitions and 1 Consumer

Now let's learn about 3 partitions and 1 consumer within consumer groups in Apache Kafka. 

  • The message will be published to partition randomly.
  • The message will be consumed by "consumer 1" in a round-robin.
  • One consumer can consume messages from more than one partition.


Java (programming language) kafka consumer Partition (database)

Opinions expressed by DZone contributors are their own.

Related

  • Java Consumer and Producer Messages Between Kafka Server [Video Tutorials]
  • Understanding Kafka and Event-Driven Architecture [Video Tutorials]
  • Apache Kafka in Java [Video Tutorials]: Architecture and Simple Consumer/Producer
  • Techniques You Should Know as a Kafka Streams Developer

Partner Resources

×

Comments

The likes didn't load as expected. Please refresh the page and try again.

Let's be friends: