pracdata / duckdb-pipelineLinks
Demonstrating the capabilities of DuckDB as a transformation engine for data lakes
☆31Updated last year
Alternatives and similar repositories for duckdb-pipeline
Users that are interested in duckdb-pipeline are comparing it to the libraries listed below
Sorting:
- ☆40Updated 8 months ago
- Python package for querying iceberg data through duckdb.☆70Updated last year
- ☆62Updated 7 months ago
- Data Product Portal created by Dataminded☆196Updated last week
- ☆167Updated 7 months ago
- DataOps Data Quality TestGen is part of DataKitchen's Open Source Data Observability. DataOps TestGen delivers simple, fast data qualit…☆66Updated this week
- Unity Catalog UI☆43Updated last year
- A portable Datamart and Business Intelligence suite built with Docker, sqlmesh + dbtcore, DuckDB and Superset☆55Updated 2 months ago
- A portable Datamart and Business Intelligence suite built with Docker, Dagster, dbt, DuckDB and Superset☆257Updated last week
- The Open-Source Enterprise Data Platform in a single Portal☆263Updated this week
- Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.☆176Updated this week
- Yet Another (Spark) ETL Framework☆21Updated 2 years ago
- A write-audit-publish implementation on a data lake without the JVM☆45Updated last year
- Data-aware orchestration with dagster, dbt, and airbyte☆31Updated 2 years ago
- Example Dagster Cloud code for the Hooli Data Engineering organization.☆19Updated 2 months ago
- ☆80Updated last year
- end-to-end data engineering project to get insights from PyPi using python, duckdb, MotherDuck & Evidence☆229Updated last week
- Pushdown compute from Snowflake to DuckDB running on your infrastructure☆200Updated 2 months ago
- ☆360Updated last week
- ☆14Updated 7 months ago
- Modern serverless lakehouse implementing HOOK methodology, Unified Star Schema (USS), and Analytical Data Storage System (ADSS) principle…☆123Updated 8 months ago
- Data Mesh Manager (Community Edition)☆48Updated last month
- Sample code to collect Apache Iceberg metrics for table monitoring☆29Updated last year
- Installer for DataKitchen's Open Source Data Observability Products. Data breaks. Servers break. Your toolchain breaks. Ensure your team …☆129Updated last month
- Get started with dbt in less than 1 minute from `git clone` to `dbt docs serve` for free!☆238Updated last month
- Quickstart for any service☆167Updated this week
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆176Updated last month
- A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects☆225Updated 7 months ago
- Sample configuration to deploy a modern data platform.☆89Updated 3 years ago
- Quick Guides from Dremio on Several topics☆79Updated last month