Step by step instructions to create a production-ready data pipeline
☆58Dec 23, 2024Updated last year
Alternatives and similar repositories for de_project
Users that are interested in de_project are comparing it to the libraries listed below
Sorting:
- A custom end-to-end analytics platform for customer churn☆11May 15, 2025Updated 9 months ago
- Repo for CDC with debezium blog post☆29Sep 15, 2024Updated last year
- Repository for Data Engineering Interview Series☆36Oct 17, 2024Updated last year
- Code to demonstrate data engineering metadata & logging best practices☆21Mar 12, 2024Updated last year
- Code to help generate SQL for stakeholders. Code at https://www.startdataengineering.com/post/data-democratize-llm/☆13May 24, 2024Updated last year
- End-to-End ELT data pipeline with Postgres, Airbyte, dbt, Dagster, Snowflake and Metabase☆11Jul 13, 2023Updated 2 years ago
- Example repo to create end to end tests for data pipeline.☆25Jun 14, 2024Updated last year
- ☆15Dec 11, 2023Updated 2 years ago
- Primary repository for NYC DCP's Data Engineering team☆34Updated this week
- Transform data from on-premises SQL Server to Azure Delta Lake Storage for Analytics and Visualization☆21Jul 16, 2023Updated 2 years ago
- Simple stream processing pipeline☆110Jun 17, 2024Updated last year
- Sample repo for startdataengineering DE 101 free course☆74Jun 24, 2024Updated last year
- Project for "Data pipeline design patterns" blog.☆50Aug 6, 2024Updated last year
- Analytics engineering with dbt - projects and developer environment☆22Sep 27, 2024Updated last year
- This is project documentation templates derived from CRISP-DM to be used for Data Engineering projects.☆61Aug 16, 2021Updated 4 years ago
- Beginner data engineering project - batch edition☆565Jan 22, 2025Updated last year
- Sample project to demonstrate data engineering best practices☆204Feb 24, 2024Updated 2 years ago
- Simple ETL pipeline using Python☆29May 22, 2023Updated 2 years ago
- ☆13Apr 18, 2024Updated last year
- Repository for the dbt Semantic Layer course☆11Nov 13, 2025Updated 3 months ago
- Beyond Vibe Coding. Code, Planning, Documentation and Product Management agents.☆70Feb 20, 2026Updated last week
- Practical Data Engineering: A Hands-On Real-Estate Project Guide☆774Sep 3, 2024Updated last year
- This project showcases how to integrate the world of DevOps, focusing on Continuous Integration (CI) and Continuous Deployment (CD) with …☆15Dec 27, 2023Updated 2 years ago
- DBT and clickhouse test project with dagster☆12Aug 29, 2023Updated 2 years ago
- ☆13Jul 1, 2025Updated 8 months ago
- This project serves as a comprehensive guide to building an end-to-end data engineering pipeline using TCP/IP Socket, Apache Spark, OpenA…☆43Jan 4, 2024Updated 2 years ago
- An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Ka…☆316Feb 14, 2025Updated last year
- This repository contains various algorithms and data structure problems.☆12Aug 7, 2017Updated 8 years ago
- Dark Patterns in Chatbot Design☆17Jun 15, 2024Updated last year
- Rust And Delta Demo. Explanation and walkthrough on delta-rs☆10Aug 21, 2023Updated 2 years ago
- The protogen package makes it easy to write protoc plugins in Python☆16Jun 17, 2025Updated 8 months ago
- Trying out the Dataframe Polars library with Delta Lake ... feat Python.☆12Jan 29, 2025Updated last year
- ☆10Jul 7, 2023Updated 2 years ago
- ☆10Mar 22, 2021Updated 4 years ago
- A Wordle clone for the terminal. Written in Rust.☆13Jan 18, 2022Updated 4 years ago
- PubSub / Event Bus library☆10Oct 18, 2016Updated 9 years ago
- A BigQuery adapter for Harlequin, a SQL IDE for the terminal.☆10Jan 19, 2025Updated last year
- A template repository to create a data project with IAC, CI/CD, Data migrations, & testing☆290Jul 11, 2024Updated last year
- This is my capstone project for the Data Incubator Data Science Fellowship. This project aims at building a tool that provides visualizat…☆10Nov 6, 2019Updated 6 years ago