pracdata / duckdb-pipelineLinks
Demonstrating the capabilities of DuckDB as a transformation engine for data lakes
☆30Updated 10 months ago
Alternatives and similar repositories for duckdb-pipeline
Users that are interested in duckdb-pipeline are comparing it to the libraries listed below
Sorting:
- ☆38Updated 3 months ago
- Example Dagster Cloud code for the Hooli Data Engineering organization.☆8Updated this week
- Sample code to collect Apache Iceberg metrics for table monitoring☆28Updated 11 months ago
- Yet Another (Spark) ETL Framework☆21Updated last year
- ☆56Updated 3 months ago
- The Open-Source Enterprise Data Platform in a single Portal☆250Updated this week
- ☆12Updated 2 months ago
- A write-audit-publish implementation on a data lake without the JVM☆46Updated 11 months ago
- end-to-end data engineering project to get insights from PyPi using python, duckdb, MotherDuck & Evidence☆215Updated last month
- Data product portal created by Dataminded☆187Updated this week
- Python package for querying iceberg data through duckdb.☆70Updated last year
- ☆150Updated 2 months ago
- Cost Efficient Data Pipelines with DuckDB☆55Updated 2 months ago
- Contribute to dlt verified sources 🔥☆90Updated this week
- Installer for DataKitchen's Open Source Data Observability Products. Data breaks. Servers break. Your toolchain breaks. Ensure your team …☆124Updated last week
- SQLMesh example projects☆32Updated last month
- A portable Datamart and Business Intelligence suite built with Docker, Dagster, dbt, DuckDB and Superset☆236Updated 5 months ago
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆160Updated last week
- Test data management tool for any data source, batch or real-time. Generate, validate and clean up data all in one tool.☆67Updated 3 weeks ago
- Repo for orienting dbt users to the Dagster asset framework☆54Updated 2 years ago
- ☆80Updated 9 months ago
- Pushdown compute from Snowflake to DuckDB running on your infrastructure☆188Updated this week
- DataOps Data Quality TestGen is part of DataKitchen's Open Source Data Observability. DataOps TestGen delivers simple, fast data qualit…☆60Updated last week
- A simple and easy to use Data Quality (DQ) tool built with Python.☆50Updated last year
- Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.☆130Updated this week
- Unity Catalog UI☆42Updated 11 months ago
- Modern serverless lakehouse implementing HOOK methodology, Unified Star Schema (USS), and Analytical Data Storage System (ADSS) principle…☆115Updated 4 months ago
- New generation opensource data stack☆70Updated 3 years ago
- All things awesome related to Dagster!☆122Updated last month
- Possibly the fastest DataFrame-agnostic quality check library in town.☆201Updated 2 weeks ago