Code snippets for Data Engineering Design Patterns book
☆433Jun 13, 2026Updated 4 months ago
Alternatives and similar repositories for data-engineering-design-patterns-book
Users that are interested in data-engineering-design-patterns-book are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆16Mar 2, 2024Updated 2 years ago
- Code for "Efficient Data Processing in Spark" Course☆396Jun 29, 2026Updated 3 months ago
- Deploy a complete data stack in just a couple of minutes.☆15Mar 6, 2024Updated 2 years ago
- An end-to-end, containerized data pipeline for near-real-time user event analytics using Kafka, ClickHouse, Airflow, and PySpark. Made to…☆80Sep 12, 2025Updated last year
- This is a repo with links to everything you'd ever want to learn about data engineering☆44,508Aug 3, 2026Updated 2 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Python Testing for Databricks☆142Aug 3, 2026Updated 2 months ago
- Fabric Data Warehouse Automation☆18Jun 3, 2026Updated 4 months ago
- ☆123Jan 15, 2025Updated last year
- ☆1,082Dec 31, 2025Updated 9 months ago
- Apache Airflow Best Practices, published by Packt☆55Apr 22, 2026Updated 5 months ago
- Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼☆46,267Updated this week
- Query Iceberg in Trino, Nessie as Catalog, and use minio to replace AWS S3☆27Aug 7, 2025Updated last year
- This repository hosts materials for the Docker for Data Engineers workshop, offering hands-on exercises and resources tailored for data e…☆15May 23, 2024Updated 2 years ago
- PySpark test helper methods with beautiful error messages☆776Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- On-premises ELT Pipeline☆32Jul 10, 2025Updated last year
- Sonnet Scripts are a collection of pre-built data architecture patterns that you can quickly spin up on a local machine, along with examp…☆41Jan 9, 2026Updated 9 months ago
- Sample project to demonstrate data engineering best practices☆228Feb 24, 2024Updated 2 years ago
- ☆17Dec 12, 2024Updated last year
- ☆12Mar 17, 2022Updated 4 years ago
- This project serves as a comprehensive guide to building an end-to-end data engineering pipeline using TCP/IP Socket, Apache Spark, OpenA…☆47Jan 4, 2024Updated 2 years ago
- Advanced Spark SQL for Data Engineers☆14Jun 21, 2025Updated last year
- ☆70Aug 6, 2024Updated 2 years ago
- ELT Data Pipeline implementation in Data Warehousing environment☆31May 2, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆40Aug 11, 2024Updated 2 years ago
- Workshop material for DuckDB workshop at Pydata DE☆15Sep 1, 2025Updated last year
- Code for Apache Hudi, Apache Iceberg and Delta Lake analysis☆10Feb 2, 2024Updated 2 years ago
- Local Environment to Practice Data Engineering☆143Dec 30, 2024Updated last year
- ☆66Jan 9, 2024Updated 2 years ago
- Code for the second edition of Data Pipelines with Apache Airflow Book☆61Feb 11, 2026Updated 8 months ago
- Open-source data contract testing for Snowflake, Databricks, BigQuery, Kafka & 15 more. Built on the Open Data Contract Standard (ODCS). …☆1,092Updated this week
- The resources of the preparation course for Databricks Data Engineer Associate certification exam☆739Aug 12, 2026Updated 2 months ago
- A portable Datamart and Business Intelligence suite built with Docker, sqlmesh + dbtcore, DuckDB and Superset☆61Oct 4, 2026Updated 2 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- SQLMesh example projects☆42Jul 2, 2025Updated last year
- End-to-end data platform: A PoC Data Platform project utilizing modern data stack (Spark, Airflow, DBT, Trino, Lightdash, Hive metastore,…☆50Oct 14, 2024Updated 2 years ago
- Repository for code examples for the book "Hands-on RAG for production"☆43Aug 8, 2026Updated 2 months ago
- This project provides a comprehensive data pipeline solution to extract, transform, and load (ETL) Reddit data into a Redshift data wareh…☆229Oct 23, 2023Updated 2 years ago
- ☆89Updated this week
- ☆74Jan 20, 2026Updated 8 months ago
- Examples for High Performance Spark☆16Oct 25, 2025Updated 11 months ago