Databricks Platform - Architecture, Security, Automation and much more!!
aws security gcp databricks azure-databricks deltalake databricks-rest-api databricks-dbconnect databricks-platform databricks-cli lakehouse-architectures
- Updated
- Python
#
lakehouse-architectures
Here are 8 public repositories matching this topic...
Medallion Architecture for Data Engineering projects
databricks dataplatform dataengineering lakehouse data-lakehouse datalakehouse dataplatforms medallion-architecture medallionarchitecture databricks-asset-bundles medallion databricks-asset-bundle databricks-product lakehouse-architectures lakeflow-declarative-pipelines lakeflow-jobs lakeflow
- Updated
This repository contains my first end-to-end Data Engineering project, built using Microsoft Azure Cloud and Azure Databricks with PySpark.
data cloud spark azure pyspark data-structures data-engineering databricks microsoft-azure delta-lake etl-pipelines lakehouse data-lakehouse medallion-architecture lakehouse-architectures
- Updated
- Jupyter Notebook
Complete portfolio of data engineering projects from Udacity's Data Engineering with AWS Nanodegree.
apache-spark relational-databases nosql-database airflow-dags etl-pipelines lakehouse-architectures automated-workflows-using-aws-services
- Updated
- Jupyter Notebook
NYC Spark Lakehouse ML Pipeline | PySpark, Docker, CI/CD
docker engineering distributed-systems data apache-spark ci-cd pyspark parquet lakehouse-architectures
- Updated
- Python
A real-time data engineering project that ingests live Wikipedia edit events and processes them using the Databricks Lakehouse Medallion Architecture
apache-spark data-engineering databricks real-time-data data-pipeline real-time-analytics spark-structured-streaming etl-pipeline delta-lake streaming-data-pipelines databricks-sql medallion-architecture lakehouse-architectures event-stream-processing json-stream-processing
- Updated
- Jupyter Notebook
End-to-end Modern Data Platform Architecture portfolio covering Serverless Data Warehouse (AWS), MultiCloud Data Pipelines, Self-Service Analytics, Augmented Analytics with LLMs, Data APIs, Governance, Observability, Databricks Lakehouse, and a 7-layer Modern Data Stack implementation.
cloud-native enterprise-data-architecture data-mesh data-strategy serverless-data lakehouse-architectures fabric-architecture scalable-data-platform data-governance-framework
- Updated
Enterprise-grade Microsoft Fabric Lakehouse project implementing Medallion architecture (Bronze, Silver, Gold) for financial transactio
semantic etl pyspark pyspark-notebook etl-pipeline pyspark-python delta-lake scd-type-2 power-bi-dax power-bi-project power-bi-dashboard medallion-architecture data-engineering-project microsoft-fabric-data-engineer lakehouse-architectures
- Updated
- Python
Improve this page
Add a description, image, and links to the lakehouse-architectures topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the lakehouse-architectures topic, visit your repo's landing page and select "manage topics."