How to: Refine Hive ZooKeeper Lock Manager Implementation

Hive has been using ZooKeeper as distributed lock manager to support concurrency in HiveServer2. The ZooKeeper-based lock manager works fine…

Read More »

How to Analyze Highly Dynamic Datasets with Apache Drill

Today’s data is dynamic and application-driven. The growth of a new era of business applications driven by industry trends such…

Read More »

Hadoop and the OpenDataPlatform

Pivotal, IBM and Hortonworks announced today the “Open Data Platform” (ODP) – an attempt to standardize Hadoop. This move seems…

Read More »

Streaming Big Data: Storm, Spark and Samza

There are a number of distributed computation systems that can process Big Data in real time or near-real time. This…

Read More »

Lambda Architecture for Big Data

An increasing number of systems are being built to handle the Volume, Velocity and Variety of Big Data, and hopefully help gain new…

Read More »

Open Source Cloud Formation with Minotaur for Mesos, Kafka and Hadoop

Today I am happy to announce “Minotaur” which is our Open Source AWS based infrastructure for managing big data open source…

Read More »

Hazelcast member discovery using Curator and ZooKeeper

At one project I was setting up Hazelcast cluster in a private cloud. Within cluster all nodes must see each…

Read More »

Big Data… Is Hadoop the good way to start?

In the past 2 years, I have met many developers, architects that are working on “big data” projects. This sounds…

Read More »

ZooKeeper on Kubernetes

The last couple of weeks I’ve been playing around with docker and kubernetes. If you are not familiar with kubernetes…

Read More »