pracdata / duckdb-pipeline
Demonstrating the capabilities of DuckDB as a transformation engine for data lakes
☆23Updated 5 months ago
Alternatives and similar repositories for duckdb-pipeline:
Users that are interested in duckdb-pipeline are comparing it to the libraries listed below
- Modern serverless lakehouse implementing HOOK methodology, Unified Star Schema (USS), and Analytical Data Storage System (ADSS) principle…☆83Updated this week
- A portable Datamart and Business Intelligence suite built with Docker, sqlmesh + dbtcore, DuckDB and Superset☆49Updated 4 months ago
- Sample code to collect Apache Iceberg metrics for table monitoring☆25Updated 7 months ago
- Nicely modeled data built on the Github Archive.☆63Updated last year
- ☆74Updated 5 months ago
- Using DuckDB with AWS Lambda to process Delta Lake data☆23Updated last month
- Example files used in the DuckDB - Unity Catalog blog☆10Updated 3 months ago
- ☆17Updated 7 months ago
- Contribute to dlt verified sources 🔥☆82Updated last week
- A write-audit-publish implementation on a data lake without the JVM☆46Updated 7 months ago
- Unity Catalog UI☆40Updated 6 months ago
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆134Updated 2 months ago
- Python package for querying iceberg data through duckdb.☆64Updated last year
- A simple and easy to use Data Quality (DQ) tool built with Python.☆49Updated last year
- ☆15Updated last year
- Data-aware orchestration with dagster, dbt, and airbyte☆31Updated 2 years ago
- ☆13Updated last year
- New generation opensource data stack☆65Updated 2 years ago
- Repo for orienting dbt users to the Dagster asset framework☆54Updated 2 years ago
- end-to-end data engineering project to get insights from PyPi using python, duckdb, MotherDuck & Evidence☆190Updated 2 weeks ago
- Example Dagster Cloud code for the Hooli Data Engineering organization.☆1Updated last week
- ☆11Updated 3 months ago
- Open Data Stack Projects: Examples of End to End Data Engineering Projects☆78Updated last year
- All things awesome related to Dagster!☆100Updated last month
- Alto is a versatile data integration tool that allows you to easily run Singer plugins, build and cache PEX files encapsulating those plu…☆59Updated last year
- DuckDB API integrations☆29Updated last month
- ☆15Updated 4 months ago
- Utility functions for dbt projects running on Spark☆31Updated last month
- Test data management tool for any data source, batch or real-time. Generate, validate and clean up data all in one tool.☆49Updated last month
- ☆47Updated 2 weeks ago