Kafka & Zookeeper for Development: Local and Docker

Kafka popularity increases every day more and more as it takes over the streaming world. It is already provided out…

Read More »

Processing real-time data with Storm, Kafka and ElasticSearch – Part 1

This is an article of processing real-time data with Storm, Kafka and ElasticSearch. 1. Introduction How would you process a…

Read More »

It is never enough of them: enriching Apache Avro generated classes with custom Java annotations

Apache Avro, along with Apache Thrift and Protocol Buffers, is often being used as a platform-neutral extensible mechanism for serializing…

Read More »

Challenges of moving from Kafka Mirror Maker to Brooklin for SSL Kafka Brokers

Problem Moving from Kafka mirror maker to Brooklin has its advantages written by me here. But doing this migration is…

Read More »

Kafka – Exactly-Once Semantics

In distributed environment failure is a very common scenario that can be happened any time. In the Kafka environment, the…

Read More »

Long Live ETL

Extract transform load is process for pulling data from one datasystem and loading into another datasystem. Datasystem involved are called…

Read More »

Send your data async on Kafka

For a project, I’m trying to log the basic transactions of the user such as addition and removal of an…

Read More »

Microservices in Publish-Subscribe communication using Apache Kafka as a Messaging Systems and validated through Integration Test

Publish-Subscribe Messaging systems play an important role in any enterprise architecture as it enables reliable integration without tightly coupling the…

Read More »

Apache Kafka & KSQL & TensorFlow for Data Scientists via Python & Jupyter Notebook

Why would a data scientist use Kafka Jupyter Python KSQL TensorFlow all together in a single notebook? There is an…

Read More »