Comparing SQL Functions and Performance with Apache Spark and Apache Drill

SQL engines for Hadoop differ in their approach and functionality. My focus for this blog post is to compare and…

Read More »

MapReduce Design Patterns Implemented in Apache Spark

This blog is a first in a series that discusses some design patterns from the book MapReduce design patterns and…

Read More »

Introduction to Apache Spark with Examples and Use Cases

I first heard of Spark in late 2013 when I became interested in Scala, the language in which Spark is…

Read More »

Spark 101: What Is It, What It Does, and Why It Matters

Recently, a new name has entered many of the conversations about big data. Some people see the popular newcomer Apache…

Read More »

Resource Allocation Configuration for Spark on YARN

In this blog post, I will explain the resource allocation configurations for Spark on YARN, describe the yarn-client and yarn-cluster…

Read More »

Spark Backend for Apache Gora

I’ve worked for Spark backend of Apache Gora as my GSoC 2015 project and finished it. At this blog post, I’ll…

Read More »

Apache Spark: 5 Pitfalls You MUST Solve Before Changing Your Architecture

The top 5 things you need to know before moving to Apache Spark It seems like everyone’s only talking about…

Read More »

Spark, Parquet and S3 – It’s complicated

(A version of this post was originally posted in AppsFlyer’s blog. Also special thanks to Morri Feldman and Michael Spector…

Read More »

Getting started with Spark: it is possible to create lightweight RESTful application also in Java

Recently I have been writing a RESTful service using Spark, a web framework for Java (which is not related to Apache Spark). When we…

Read More »