josephmachado / cost_effective_data_pipelines
Cost Efficient Data Pipelines with DuckDB
☆52Updated 9 months ago
Alternatives and similar repositories for cost_effective_data_pipelines:
Users that are interested in cost_effective_data_pipelines are comparing it to the libraries listed below
- A simple and easy to use Data Quality (DQ) tool built with Python.☆50Updated last year
- Code for my "Efficient Data Processing in SQL" book.☆56Updated 8 months ago
- A portable Datamart and Business Intelligence suite built with Docker, sqlmesh + dbtcore, DuckDB and Superset☆50Updated 5 months ago
- Sample project that use Dagster, dbt, DuckDB and Dash to visualize car and motorcycle Spanish market☆58Updated 2 years ago
- ☆16Updated last year
- Repo for CDC with debezium blog post☆28Updated 7 months ago
- ☆36Updated last month
- A "modern" Strava data pipeline fueled by dlt, duckdb, dbt, and evidence.dev☆32Updated 3 months ago
- Code for data quality with greatexpectations blog☆12Updated 9 months ago
- Repo for orienting dbt users to the Dagster asset framework☆54Updated 2 years ago
- Full stack data engineering tools and infrastructure set-up☆52Updated 4 years ago
- Open Data Stack Projects: Examples of End to End Data Engineering Projects☆83Updated last year
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆27Updated 2 years ago
- A FastMCP tool to search and retrieve Polars API documentation.☆46Updated 2 weeks ago
- csv and flat-file sniffer built in Rust.☆42Updated last year
- Nicely modeled data built on the Github Archive.☆65Updated last year
- Contribute to dlt verified sources 🔥☆83Updated last week
- A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.☆23Updated last year
- A dbt-Core package for generating models from an activity stream.☆41Updated last year
- Dagster University courses☆81Updated last week
- build dw with dbt☆44Updated 6 months ago
- Data-aware orchestration with dagster, dbt, and airbyte☆31Updated 2 years ago
- ☆30Updated 10 months ago
- A Python package that creates fine-grained dbt tasks on Apache Airflow☆68Updated 7 months ago
- 🏁 A sweet and speedy code generator for dbt 🏎️✨☆27Updated 10 months ago
- ☆54Updated 10 months ago
- Linear regression in SQL using dbt☆70Updated 3 months ago
- end-to-end data engineering project to get insights from PyPi using python, duckdb, MotherDuck & Evidence☆197Updated last month
- Code to help generate SQL for stakeholders. Code at https://www.startdataengineering.com/post/data-democratize-llm/☆11Updated 11 months ago
- Using DuckDB with AWS Lambda to process Delta Lake data☆26Updated 3 months ago