A production-ready PySpark project template with medallion architecture, Python packaging, unit tests, integration tests, CI/CD automation, Databricks Asset Bundles, and DQX data quality framework.

• Updated Jun 23, 2026
• Python

This Repository has like a goal, build generic solution for use on any projects

• Updated Apr 26, 2025
• Jupyter Notebook

End-to-end SaaS subscription data platform using AWS, Databricks (Delta Lake), and Snowflake featuring streaming ingestion, CDC/SCD modeling, medallion architecture, and Iceberg-based analytics.

• Updated May 2, 2026
• Jupyter Notebook

This azure databricks project implements a modern data engineering pipeline on Azure using the Medallion Architecture (Bronze → Silver → Gold) to process NYC taxi trip data.

• Updated Apr 14, 2026
• Python

This project built an automated, end-to-end data pipeline from raw CSVs to real-time Databricks dashboards for Rideeasy Cab Aggregator.

• Updated May 22, 2026
• Jupyter Notebook

Managing and monitoring jobs in Databricks can be a daunting task, especially as the number of jobs grows. To streamline this process, we can automate the extraction of job metadata and store it in a centralized table for easy access and monitoring.

• Updated Feb 21, 2025
• Jupyter Notebook

End-to-end B2B sales pipeline built on Databricks and dbt. Medallion architecture, Delta Lake, automated Workflows, 26/26 dbt tests, and a live AI/BI dashboard across 5,000 deals and 43,160 activities.

• Updated Mar 7, 2026
• Python

Medallion pipeline over the public NYC TLC taxi dataset on Databricks Free Edition.

• Updated Jun 20, 2026
• Python