Apache Hadoop HDFS Data Node Apache Mesos Framework

Intro This project allows running HDFS on Mesos. You should be familiar with HDFS and Mesos basics: http://mesos.apache.org/documentation/latest/ https://hadoop.apache.org/docs/r2.7.2/hdfs_design.html    …

Read More »

Getting Started with Heron on Apache Mesos and Apache Kafka

Heron has been Open Sourced, woo! Heron is Twitter’s  distributed stream computation system for running Apache Storm compatible topologies in production. A Heron…

Read More »

Open Source Cloud Formation with Minotaur for Mesos, Kafka and Hadoop

Today I am happy to announce “Minotaur” which is our Open Source AWS based infrastructure for managing big data open source…

Read More »

Resource scheduling and task launching with Apache Mesos and Apache Aurora at Twitter

Episode # 23 of the podcast was a talk with Bill Farner Bill explained how Twitter, using Apache Mesos and Apache Aurora,…

Read More »

Apache Solr real-time live index updates at scale with Apache Hadoop

Episode # 22 of the podcast was a talk with Patrick Hunt We talked about the new work that has…

Read More »

Reporting Metrics to Apache Kafka and Monitoring with Consumers

Apache Kafka has been used for some time now by organizations to consume not only all of the data within its…

Read More »

XML to Avro Conversion

We all know what XML is right?  Just in case not, no problem here is what it is all about.…

Read More »

Getting started with Apache Mesos and Apache Aurora using Vagrant

Apache Mesos is a cluster manager that provides efficient resource isolation and sharing across distributed applications, or frameworks. Think of…

Read More »

Technology Decisions Are About Trade Offs and Solving Problems

At some point in the last decade we hit the inflection point where distributed systems, and all their complexities, became…

Read More »