pracdata / duckdb-pipelineLinks
Demonstrating the capabilities of DuckDB as a transformation engine for data lakes
☆30Updated last year
Alternatives and similar repositories for duckdb-pipeline
Users that are interested in duckdb-pipeline are comparing it to the libraries listed below
Sorting:
- ☆159Updated 5 months ago
- A portable Datamart and Business Intelligence suite built with Docker, sqlmesh + dbtcore, DuckDB and Superset☆54Updated 2 weeks ago
- Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.☆163Updated this week
- Data product portal created by Dataminded☆192Updated last week
- ☆60Updated 5 months ago
- ☆80Updated last year
- Data-aware orchestration with dagster, dbt, and airbyte☆30Updated 2 years ago
- Unity Catalog UI☆43Updated last year
- Sample code to collect Apache Iceberg metrics for table monitoring☆28Updated last year
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆170Updated 2 weeks ago
- Installer for DataKitchen's Open Source Data Observability Products. Data breaks. Servers break. Your toolchain breaks. Ensure your team …☆128Updated 3 weeks ago
- Modern serverless lakehouse implementing HOOK methodology, Unified Star Schema (USS), and Analytical Data Storage System (ADSS) principle…☆119Updated 7 months ago
- The Open-Source Enterprise Data Platform in a single Portal☆259Updated this week
- Example Dagster Cloud code for the Hooli Data Engineering organization.☆16Updated 2 weeks ago
- Python package for querying iceberg data through duckdb.☆70Updated last year
- Edit your data contract in the Data Contract Editor☆25Updated last year
- A portable Datamart and Business Intelligence suite built with Docker, Dagster, dbt, DuckDB and Superset☆251Updated 3 weeks ago
- end-to-end data engineering project to get insights from PyPi using python, duckdb, MotherDuck & Evidence☆226Updated 2 weeks ago
- A write-audit-publish implementation on a data lake without the JVM☆45Updated last year
- Contribute to dlt verified sources 🔥☆99Updated last week
- Open Data Stack Projects: Examples of End to End Data Engineering Projects☆90Updated 2 years ago
- A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.☆26Updated last year
- ☆39Updated 6 months ago
- A DuckDB-powered command line interface for Snowflake security, governance, operations, and cost optimization.☆41Updated last year
- Nicely modeled data built on the Github Archive.☆68Updated last year
- The shared semantic layer definitions that dbt-core and MetricFlow use.☆87Updated 2 weeks ago
- Dagster SQLMesh Adapter☆75Updated last month
- New generation opensource data stack☆74Updated 3 years ago
- Get started with dbt in less than 1 minute from `git clone` to `dbt docs serve` for free!☆232Updated 5 months ago
- Yet Another (Spark) ETL Framework☆21Updated 2 years ago