Welcome to my data engineering projects repository! Here you will find a collection of data engineering projects that I have worked on.
☆24Apr 27, 2023Updated 2 years ago
Alternatives and similar repositories for data-engineering-projects
Users that are interested in data-engineering-projects are comparing it to the libraries listed below
Sorting:
- ☆12Feb 23, 2022Updated 4 years ago
- Construindo Pipeline de Dados com Astro Python SDK, dbt & Apache Airflow☆10Mar 20, 2024Updated 2 years ago
- Sample Project to Learn Data Engineering☆10Aug 1, 2021Updated 4 years ago
- Data pipeline to build a data warehouse on Postgres☆14Aug 11, 2024Updated last year
- An analysis on unicorn companies☆10Jul 22, 2023Updated 2 years ago
- ☆37Aug 21, 2020Updated 5 years ago
- Business Intelligence and Data Warehousing Project☆13Dec 4, 2019Updated 6 years ago
- an end-to-end data pipeline extracting music listening habits and producing an insightful dashboard☆17Mar 31, 2024Updated last year
- Spark Structured Streaming data pipeline that processes movie ratings data in real-time.☆13Mar 1, 2026Updated 3 weeks ago
- 🌟 An end-to-end full-stack data science project, including modelling, MLOps, and data storytelling. ✨☆16Aug 30, 2025Updated 6 months ago
- Get Crypto data from API, stream it to Kafka with Airflow. Write data to MySQL and visualize with Metabase☆17Oct 2, 2023Updated 2 years ago
- Repo for CDC with debezium blog post☆29Sep 15, 2024Updated last year
- StarCraft 2 Data Pipeline with Airflow, DuckDB and Streamlit☆16Mar 14, 2024Updated 2 years ago
- ☆12May 24, 2025Updated 9 months ago
- In this project I have built etl pipline which scraps the trending repository based on month,week and day LIVE extract other related info…☆12Sep 9, 2023Updated 2 years ago
- Advanced C++ By Example course. Currently in developemnt.☆40Jan 11, 2026Updated 2 months ago
- ☆11Oct 8, 2020Updated 5 years ago
- ☆15Nov 11, 2023Updated 2 years ago
- Source Code for 'Azure Data Factory' by Example by Richard Swinbank☆17Jun 21, 2021Updated 4 years ago
- PDF AI Assistant Powered By Genimi☆11Mar 24, 2024Updated last year
- ☆10Feb 27, 2025Updated last year
- Formação Engenheiro de Dados Cloud e Big Data (Azure & DataBricks)☆18Oct 31, 2023Updated 2 years ago
- ☆21Mar 11, 2025Updated last year
- This repo contains all the code, slides and other reference documents used in community sessions.☆14Mar 29, 2023Updated 2 years ago
- ☆13Updated this week
- End-to-end ELT data engineering project☆22Dec 24, 2022Updated 3 years ago
- how to unit test your PySpark code☆29Mar 26, 2021Updated 4 years ago
- Static Fire is an engine for creating static websites, primarily blogs.☆16Jan 22, 2024Updated 2 years ago
- End to end data engineering project with kafka, airflow, spark, postgres and docker.☆110Jan 8, 2026Updated 2 months ago
- Hexo个人博客☆45Oct 27, 2025Updated 4 months ago
- Implementation of realworld app backend api☆10Jul 17, 2023Updated 2 years ago
- velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…☆20Aug 12, 2025Updated 7 months ago
- ☆15Feb 18, 2022Updated 4 years ago
- Hand Dino Game OpenCV Python☆13Feb 19, 2020Updated 6 years ago
- https://phohoccode.github.io/Watch-movies/index.html☆11Apr 23, 2024Updated last year
- Skooldio: Data Pipelines with Airflow☆23May 24, 2025Updated 9 months ago
- Guide to make aws custom lambda layer to support openai☆10Jul 28, 2024Updated last year
- ☆13May 19, 2023Updated 2 years ago
- This Streamlit application allows users to interact with their PostgreSQL database using natural language queries. Users can type questio…☆22Oct 7, 2024Updated last year