Reading and Writing Deeply Partitioned Files in Apache Spark

In large-scale data engineering and analytics, files are often stored in deeply partitioned directories to improve performance and manageability. This…

Read More »

Spark Microservices

As continuation of big data query system blog, i want to share more techniques for building Analytics engine. Take a problem…

Read More »