josephmachado / cost_effective_data_pipelinesView external linksLinks
Cost Efficient Data Pipelines with DuckDB
☆61May 14, 2025Updated 9 months ago
Alternatives and similar repositories for cost_effective_data_pipelines
Users that are interested in cost_effective_data_pipelines are comparing it to the libraries listed below
Sorting:
- Code for blog at https://www.startdataengineering.com/post/python-for-de/☆98Jun 7, 2024Updated last year
- Repo for CDC with debezium blog post☆29Sep 15, 2024Updated last year
- Code to demonstrate data engineering metadata & logging best practices☆20Mar 12, 2024Updated last year
- A custom end-to-end analytics platform for customer churn☆11May 15, 2025Updated 9 months ago
- Step by step instructions to create a production-ready data pipeline☆58Dec 23, 2024Updated last year
- Trying out the Dataframe Polars library with Delta Lake ... feat Python.☆12Jan 29, 2025Updated last year
- Using DuckDB with AWS Lambda to process Delta Lake data☆32Jan 26, 2025Updated last year
- Sample project to demonstrate data engineering best practices☆202Feb 24, 2024Updated last year
- Code for data quality with greatexpectations blog☆13Jul 30, 2024Updated last year
- Flink training workshop for HadoopCon 2016 (Annual Hadoop Conference @ Taiwan)☆11Sep 14, 2016Updated 9 years ago
- Sample repo for startdataengineering DE 101 free course☆74Jun 24, 2024Updated last year
- ☆13Jul 8, 2024Updated last year
- Examples For AI Agent☆14Jan 16, 2025Updated last year
- Repository for Data Engineering Interview Series☆36Oct 17, 2024Updated last year
- Deploy a complete data stack in just a couple of minutes.☆15Mar 6, 2024Updated last year
- ☆15May 12, 2018Updated 7 years ago
- ☆16Apr 26, 2024Updated last year
- 🏁 A sweet and speedy code generator for dbt 🏎️✨☆32Jan 23, 2026Updated 3 weeks ago
- Primary repository for NYC DCP's Data Engineering team☆33Updated this week
- End to end data engineering project☆58Oct 27, 2022Updated 3 years ago
- dbt docs but windows 95☆16Jun 7, 2022Updated 3 years ago
- ☆23Jun 14, 2021Updated 4 years ago
- A dbt-Core package for generating models from an activity stream.☆43Apr 11, 2024Updated last year
- Code for "Efficient Data Processing in Spark" Course☆361Oct 16, 2025Updated 3 months ago
- Traditional Chinese (tw) translation of the Keras documentation☆19Nov 7, 2017Updated 8 years ago
- A Beginner's Guide to DuckDB's Python Client☆43Oct 16, 2024Updated last year
- This repository contains a recipe for bootstrapping a climate analysis application using Apache Pinot and Superset☆20Sep 14, 2020Updated 5 years ago
- Project for "Data pipeline design patterns" blog.☆50Aug 6, 2024Updated last year
- A fine push-down parquet scanner in Rust.☆37Updated this week
- A template for dockerized dbt-Core projects with VS Code Dev Containers.☆21Nov 14, 2022Updated 3 years ago
- This dbt package contains a set of pre-built, pre-integrated Load and Transform dbt models for common SaaS applications.☆265Oct 28, 2022Updated 3 years ago
- Analytics engineering with dbt - projects and developer environment☆22Sep 27, 2024Updated last year
- A tutorial to learn Apache Kafka and Python☆22Oct 16, 2024Updated last year
- Possibly the fastest DataFrame-agnostic quality check library in town.☆236Feb 5, 2026Updated last week
- ☆64May 27, 2025Updated 8 months ago
- The data-validation toolkit for enhanced dbt (data build tool) PR review☆437Updated this week
- ☆23Jun 3, 2021Updated 4 years ago
- ☆11Feb 17, 2022Updated 3 years ago
- Example repo to create end to end tests for data pipeline.☆25Jun 14, 2024Updated last year