Welcome to my data engineering projects repository! Here you will find a collection of data engineering projects that I have worked on.
☆26Apr 27, 2023Updated 3 years ago
Alternatives and similar repositories for data-engineering-projects
Users that are interested in data-engineering-projects are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- CDC with NiFi, Kafka Connect, Flink SQL, Cloudera Data in Motion☆11Sep 14, 2023Updated 3 years ago
- A Data Engineering Project that implements an ETL data pipeline using Dagster, Apache Spark, Streamlit, MinIO, Metabase, Dbt, Polars, Doc…☆25Nov 19, 2024Updated last year
- Sample Project to Learn Data Engineering☆10Aug 1, 2021Updated 5 years ago
- The infomations☆10Aug 23, 2026Updated 2 months ago
- Data pipeline to build a data warehouse on Postgres☆16Aug 11, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆13Mar 5, 2023Updated 3 years ago
- Personal Data Engineering Projects☆1,046Feb 8, 2023Updated 3 years ago
- This app is designed to assist applicants in searching for potential jobs and to help recruiters find talented candidates.☆15Feb 16, 2025Updated last year
- Fivetran data models for QuickBooks using dbt.☆40Updated this week
- In this project I have built etl pipline which scraps the trending repository based on month,week and day LIVE extract other related info…☆12Sep 9, 2023Updated 3 years ago
- 🌟 An end-to-end full-stack data science project, including modelling, MLOps, and data storytelling. ✨☆16Aug 30, 2025Updated last year
- NoSQL extract, transform, load (ETL) toolkit with Python☆16Oct 19, 2026Updated 2 weeks ago
- End-to-end data platform leveraging the Modern data stack☆53Apr 10, 2024Updated 2 years ago
- System-wide Python package discovery, validation, and allow-listing☆13Sep 28, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- End to End Data Engineering Projects☆15May 13, 2024Updated 2 years ago
- scrapeflow-react☆10Dec 17, 2024Updated last year
- ☆12Mar 6, 2021Updated 5 years ago
- Spark Structured Streaming data pipeline that processes movie ratings data in real-time.☆14Oct 23, 2026Updated last week
- Profiling Spark Applications for Performance Comparison and Diagnosis☆16Nov 11, 2018Updated 7 years ago
- The project aims to automate the extraction of data from a YouTube channel, transform the data into a suitable format, and make it availa…☆12Sep 24, 2023Updated 3 years ago
- Get Crypto data from API, stream it to Kafka with Airflow. Write data to MySQL and visualize with Metabase☆17Oct 2, 2023Updated 3 years ago
- A comprehensive, production-focused guide to acing AI/ML system design interviews at top tech companies.☆31Sep 1, 2026Updated 2 months ago
- Guides☆10Jan 18, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Examples of Clean Architecture in Python, with folders matching the classic circle diagram.☆13Oct 9, 2026Updated 3 weeks ago
- Repo for CDC with debezium blog post☆32Sep 15, 2024Updated 2 years ago
- ☆20Mar 11, 2025Updated last year
- Try to code some algorithms☆17Apr 3, 2025Updated last year
- Formação Engenheiro de Dados Cloud e Big Data (Azure & DataBricks)☆18Oct 31, 2023Updated 3 years ago
- ☆10Feb 27, 2025Updated last year
- 100% vibe coded 🏄♂️☆12Sep 19, 2025Updated last year
- Designed and implemented a Task Management Application using React, Node.js, Express.js, and MongoDB. Key features include secure JWT aut…☆13Dec 7, 2024Updated last year
- ☆11Dec 17, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This is my portfolio website built using Figma template. I use the portfolio website to showcase my work and professional skills online a…☆12Apr 16, 2025Updated last year
- Keep your configuration files in sync☆17Jan 6, 2026Updated 9 months ago
- PDF AI Assistant Powered By Genimi☆12Mar 24, 2024Updated 2 years ago
- This repository contains code and configuration files for an Extract, Transform, Load (ETL) project using Google Cloud Data Fusion for da…☆21Feb 23, 2024Updated 2 years ago
- Integrating Apache Airflow, dbt, Great Expectations and Apache Superset to develop a modern open source data stack.☆19Jun 19, 2022Updated 4 years ago
- A dataset for Movie Recommendation with NebulaGraph, ETL to merge two dataset: OMDB & Movielens with dbt, postgres and Nebula-Importer☆17Sep 7, 2024Updated 2 years ago
- an end-to-end data pipeline extracting music listening habits and producing an insightful dashboard☆17Mar 31, 2024Updated 2 years ago