Mmodarre / Lakehouse_PlumberLinks
The Metadata Driven framework for Databricks Lakeflow Declarative Pipelines (formerly Delta Live Tables). Metadata framework that generates production ready Pyspark code for Lakeflow Declarative Pipelines
☆30Updated this week
Alternatives and similar repositories for Lakehouse_Plumber
Users that are interested in Lakehouse_Plumber are comparing it to the libraries listed below
Sorting:
- A bunch of hacks developed around dbt☆48Updated 6 years ago
- This repo is a collection of tools to deploy, manage and operate a Databricks based Lakehouse.☆46Updated 9 months ago
- ☆72Updated last week
- A repository of sample code to show data quality checking best practices using Airflow.☆78Updated 2 years ago
- SQL Queries & Alerts for Databricks System Tables access.audit Logs☆39Updated 3 months ago
- A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.☆26Updated last year
- PDF DataSource for Apache Spark, allow to read PDF files directly to the DataFrame and ocr it☆76Updated 6 months ago
- Modern serverless lakehouse implementing HOOK methodology, Unified Star Schema (USS), and Analytical Data Storage System (ADSS) principle…☆120Updated 7 months ago
- Using DuckDB with AWS Lambda to process Delta Lake data☆31Updated 9 months ago
- Rules based grant management for Snowflake☆41Updated 6 years ago
- Databricks Implementation of the TPC-DI Specification using Traditional Notebooks and/or Delta Live Tables☆89Updated 4 months ago
- ☆134Updated this week
- Common GitHub actions and workflows for maintaining dbt☆14Updated last week
- A portable Datamart and Business Intelligence suite built with Docker, sqlmesh + dbtcore, DuckDB and Superset☆54Updated last month
- Useful scripts, utilities, and tools for Snowflake☆13Updated 5 years ago
- Data engineering with dbt, published by Packt☆87Updated 2 months ago
- Data Product Portal created by Dataminded☆195Updated this week
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆169Updated 2 years ago
- Step-by-step tutorial on building a Kimball dimensional model with dbt☆153Updated last year
- Spark and Delta Lake Workshop☆22Updated 3 years ago
- Soda SQL and Soda Spark have been deprecated and replaced by Soda Core. docs.soda.io/soda-core/overview.html☆61Updated 2 years ago
- dbt adapter for Azure Synapse Dedicated SQL Pools☆75Updated 2 months ago
- Personal project for setting up an open source data warehouse.☆31Updated 4 months ago
- ☆60Updated this week
- Delta Lake examples☆231Updated last year
- ☆192Updated 3 months ago
- Yet Another (Spark) ETL Framework☆21Updated 2 years ago
- Code snippets for Data Engineering Design Patterns book☆271Updated 7 months ago
- Utility functions for dbt projects running on Spark☆33Updated 2 weeks ago
- Cloned by the `dbt init` task☆62Updated last year