Databricks framework to validate Data Quality of pySpark DataFrames and Tables
-
Updated
Aug 22, 2026 - Python
Databricks framework to validate Data Quality of pySpark DataFrames and Tables
End-to-end Data Lakehouse project built on Databricks, following the Medallion Architecture (Bronze, Silver, Gold). Covers real-world data engineering and analytics workflows using Spark, PySpark, SQL, Delta Lake, and Unity Catalog. Designed for learning, portfolio building, and job interviews.
Automated migrations to Unity Catalog
A cloud-native data pipeline and visualization project analyzing Formula 1 racing data using Azure, Databricks, Delta Lake, Tableau, and Python for insightful EDA and interactive dashboards.
Open, Multi-modal Catalog for Data & AI, written in Rust
Production-ready PySpark ETL template for Databricks — medallion architecture, DABs, tests, DQX, CI/CD, and agentic development with Claude Code.
Governed, provenance-sealed creative rendering for Databricks — a Streamlit App + Unity Catalog ai_render() function that turns any governed source (Sample Lakehouse, UC, Genie, or BYO data) into infographics, reports, decks, video briefings, music, and podcasts.
Notebooks, terraform, tools to enable setting up Unity Catalog
Visual intelligence tool for Databricks workspaces. Builds a live ontology of Unity Catalog assets, compute, jobs, dashboards, and apps as entities with semantic relationships, enriched with cost attribution, lineage, and governance insights.
Production-grade Databricks infrastructure templates for Azure. Deploy in 20 minutes with VNet injection, Unity Catalog, managed identity. Perfect for learning and prototyping. Free and open source.
Open-source community study guide for all six Databricks certifications (Data Engineer Associate / Professional, Data Analyst Associate, ML Associate / Professional, GenAI Engineer Associate). Aligned to the 2025-2026 official exam guides. Obsidian-flavoured Markdown; PRs welcome.
AI-powered Databricks platform engineering — provision workspaces, configure Unity Catalog, manage identity & governance, and set up networking across Azure, AWS, and GCP, all through natural language with Claude.
Unity Catalog Explorer is a TypeScript + Next.js based Web UI for the Unity Catalog OSS.
Databricks cost observability app — cloud-agnostic, MOCK_MODE for free-tier workspaces
How to Configure Azure Databricks Unity Catalog using Terraform
SchemaX - Automatic Schema Management
End-to-end Azure Databricks retail data engineering project using Medallion Architecture (Bronze, Silver, Gold). Implements Auto Loader, Unity Catalog, Delta Lake, SCD Type 1 & 2 dimensions, and Fact Orders for analytics-ready star schema modeling.
Enterprise Databricks app factory using @databricks Genie Code Agent Mode — 90+ apps at Alpura. Presented at DATA+AI Summit 2026.
End-to-end Azure Data Engineering project using ADF for incremental ingestion, Databricks (DLT) for Medallion Architecture, and Delta Lake for CDC (SCD Type 1). Managed via Databricks Asset Bundles (DABs) for professional CI/CD. Focuses on real-time streaming, scalability, and Star Schema modeling.
Add a description, image, and links to the unity-catalog topic page so that developers can more easily learn about it.
To associate your repository with the unity-catalog topic, visit your repo's landing page and select "manage topics."