Code snippets for Data Engineering Design Patterns book
☆418Jun 13, 2026Updated 2 months ago
Alternatives and similar repositories for data-engineering-design-patterns-book
Users that are interested in data-engineering-design-patterns-book are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆16Mar 2, 2024Updated 2 years ago
- Code for "Efficient Data Processing in Spark" Course☆394Jun 29, 2026Updated last month
- Deploy a complete data stack in just a couple of minutes.☆15Mar 6, 2024Updated 2 years ago
- An end-to-end, containerized data pipeline for near-real-time user event analytics using Kafka, ClickHouse, Airflow, and PySpark. Made to…☆81Sep 12, 2025Updated 11 months ago
- ☆26Jan 31, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This is a repo with links to everything you'd ever want to learn about data engineering☆43,764Aug 3, 2026Updated 2 weeks ago
- Python Testing for Databricks☆138Aug 3, 2026Updated 2 weeks ago
- Fabric Data Warehouse Automation☆18Jun 3, 2026Updated 2 months ago
- ☆120Jan 15, 2025Updated last year
- ☆1,079Dec 31, 2025Updated 7 months ago
- Apache Airflow Best Practices, published by Packt☆55Apr 22, 2026Updated 3 months ago
- Query Iceberg in Trino, Nessie as Catalog, and use minio to replace AWS S3☆27Aug 7, 2025Updated last year
- Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. The next cohort starts in January 2026. Jo…☆44,706Jun 10, 2026Updated 2 months ago
- This repository hosts materials for the Docker for Data Engineers workshop, offering hands-on exercises and resources tailored for data e…☆16May 23, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- PySpark test helper methods with beautiful error messages☆773Aug 9, 2026Updated last week
- On-premises ELT Pipeline☆32Jul 10, 2025Updated last year
- Sonnet Scripts are a collection of pre-built data architecture patterns that you can quickly spin up on a local machine, along with examp…☆42Jan 9, 2026Updated 7 months ago
- Sample project to demonstrate data engineering best practices☆223Feb 24, 2024Updated 2 years ago
- ☆12Mar 17, 2022Updated 4 years ago
- This project serves as a comprehensive guide to building an end-to-end data engineering pipeline using TCP/IP Socket, Apache Spark, OpenA…☆45Jan 4, 2024Updated 2 years ago
- Full stack data engineering tools and infrastructure set-up☆58Feb 13, 2021Updated 5 years ago
- ☆41Jan 24, 2023Updated 3 years ago
- ☆38Aug 11, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ELT Data Pipeline implementation in Data Warehousing environment☆31May 2, 2025Updated last year
- Code for Apache Hudi, Apache Iceberg and Delta Lake analysis☆10Feb 2, 2024Updated 2 years ago
- Workshop material for DuckDB workshop at Pydata DE☆15Sep 1, 2025Updated 11 months ago
- Local Environment to Practice Data Engineering☆142Dec 30, 2024Updated last year
- ☆66Jan 9, 2024Updated 2 years ago
- Code for the second edition of Data Pipelines with Apache Airflow Book☆55Feb 11, 2026Updated 6 months ago
- A portable Datamart and Business Intelligence suite built with Docker, sqlmesh + dbtcore, DuckDB and Superset☆61Apr 5, 2026Updated 4 months ago
- The resources of the preparation course for Databricks Data Engineer Associate certification exam☆713Updated this week
- End-to-end data platform: A PoC Data Platform project utilizing modern data stack (Spark, Airflow, DBT, Trino, Lightdash, Hive metastore,…☆50Oct 14, 2024Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆70Jan 20, 2026Updated 6 months ago
- Enforce Data Contracts☆1,038Updated this week
- Apache Arrow Guide☆17Oct 10, 2021Updated 4 years ago
- This project provides a comprehensive data pipeline solution to extract, transform, and load (ETL) Reddit data into a Redshift data wareh…☆228Oct 23, 2023Updated 2 years ago
- ☆87Updated this week
- Orchestrate Modal and OpenAI workloads with Dagster☆13Dec 11, 2024Updated last year
- Building a Data Pipeline with an Open Source Stack☆59Jun 27, 2025Updated last year