pracdata / duckdb-pipelineLinks
Demonstrating the capabilities of DuckDB as a transformation engine for data lakes
☆33Updated last year
Alternatives and similar repositories for duckdb-pipeline
Users that are interested in duckdb-pipeline are comparing it to the libraries listed below
Sorting:
- Data Product Portal created by Dataminded☆198Updated this week
- A portable Datamart and Business Intelligence suite built with Docker, sqlmesh + dbtcore, DuckDB and Superset☆55Updated 3 months ago
- A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.☆27Updated last year
- DataOps Data Quality TestGen is part of DataKitchen's Open Source Data Observability. DataOps TestGen delivers simple, fast data qualit…☆70Updated last month
- A write-audit-publish implementation on a data lake without the JVM☆45Updated last year
- end-to-end data engineering project to get insights from PyPi using python, duckdb, MotherDuck & Evidence☆232Updated 2 months ago
- Installer for DataKitchen's Open Source Data Observability Products. Data breaks. Servers break. Your toolchain breaks. Ensure your team …☆131Updated last week
- ☆178Updated 8 months ago
- Yet Another (Spark) ETL Framework☆21Updated 2 years ago
- Delta Lake Documentation☆53Updated last year
- Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.☆180Updated last week
- New generation opensource data stack☆76Updated 3 years ago
- ☆14Updated 8 months ago
- Modern serverless lakehouse implementing HOOK methodology, Unified Star Schema (USS), and Analytical Data Storage System (ADSS) principle…☆124Updated 10 months ago
- ☆65Updated 9 months ago
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, duckdb and Superset☆46Updated last month
- ☆80Updated last year
- ☆393Updated last week
- ☆41Updated 9 months ago
- ☆153Updated 2 months ago
- Sample code to collect Apache Iceberg metrics for table monitoring☆29Updated last year
- A platform and cloud-based service for data sharing based on the Delta Sharing protocol.☆21Updated last year
- JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.☆10Updated 2 years ago
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆181Updated last month
- A portable Datamart and Business Intelligence suite built with Docker, Dagster, dbt, DuckDB and Superset☆258Updated last month
- A simple and easy to use Data Quality (DQ) tool built with Python.☆51Updated 2 years ago
- Data-aware orchestration with dagster, dbt, and airbyte☆31Updated 3 years ago
- Python package for querying iceberg data through duckdb.☆73Updated last year
- A Python package that creates fine-grained dbt tasks on Apache Airflow☆82Updated 2 weeks ago
- DataOps Observability is part of DataKitchen's Open Source Data Observability. DataOps Observability monitors every data journey from da…☆50Updated 3 months ago