Logstash vs. Kafka

As organizations increasingly adopt modern data architectures, two tools often considered for data pipelines are Logstash and Apache Kafka. While…

Read More »

Processing real-time data with Storm, Kafka and ElasticSearch – Part 4

1. Introduction In the third part of this series of articles about real-time stream processing we learned how to import…

Read More »

Configuring Logstash with Filebeat

In post Configuring ELK stack to analyse Apache Tomcat logs  we configured Logstash to pull data from directory whereas in…

Read More »

ActiveMQ as a Message Broker for Logstash

When scaling Logstash it is common to add a message broker that is used to temporarily buffer incoming messages before…

Read More »

Using ELK (elasticsearch + logstash + kibana) to aggregate cassandra and spark logs

On one of my current projects we are using Cassandra and Spark Streaming to do some somewhat-close-to-real time analytics. The…

Read More »

Log Management Tools Face-Off: Splunk vs. Logstash vs. Sumo Logic

What are the main trade-offs between the leading log management tools and how to choose the one that’s right for…

Read More »

Installing Logstash v 1.4 (and Greater) on FreeBSD

In a previous post I described how to install Logstash (v. 1.3 and previous) on FreeBSD and in this post…

Read More »

An Alternative to the Twitter River – Index Tweets in Elasticsearch with Logstash

For some time now I’ve been using the Elasticsearch Twitter river for streaming conference tweets to Elasticsearch. The river runs…

Read More »

Your logs are your data: logstash + elasticsearch

Topic of today’s post stays a bit aside from day-to-day coding and development but nonetheless covers a very important subject:…

Read More »