Some example projects for Data Engineers to build, end-to-end.
☆38Nov 8, 2023Updated 3 years ago
Alternatives and similar repositories for DataEngineeringProjects
Users that are interested in DataEngineeringProjects are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This is the end to end MLOps project I built through participated the MLOps Zoomcamp☆10Sep 11, 2022Updated 4 years ago
- ☆12Jul 4, 2021Updated 5 years ago
- End to end data engineering project☆60Oct 27, 2022Updated 4 years ago
- End-to-end data platform leveraging the Modern data stack☆53Apr 10, 2024Updated 2 years ago
- Built a stream processing data pipeline to get data from disparate systems into a dashboard using Kafka as an intermediary.☆29Aug 14, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Data Engineering Practice Problems☆2,974Jan 8, 2025Updated last year
- how to unit test your PySpark code☆29Mar 26, 2021Updated 5 years ago
- ☆20Jan 23, 2023Updated 3 years ago
- Easy-to-use package to interact with the Hybrid Analysis Public API.☆11Nov 5, 2020Updated 6 years ago
- An end to end ML project. Using MLflow for experiment tracking and model registry. Prefect for workflow orchestration. S3 for artifacts s…☆12Sep 11, 2022Updated 4 years ago
- ☆51Mar 14, 2025Updated last year
- CalData's MDSA project with Caltrans on Performance Measurement System (PeMS) data☆13Nov 3, 2026Updated 2 weeks ago
- Hexagonal (ports and adapters) architecture applied to Spark and Python data engineering project☆33Jul 26, 2023Updated 3 years ago
- ☆22Jun 30, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Get Crypto data from API, stream it to Kafka with Airflow. Write data to MySQL and visualize with Metabase☆17Oct 2, 2023Updated 3 years ago
- BES (Bigdata Ecosystem Sandbox) is an all-in-one development and learning environment designed to simplify the exploration, experimentati…☆11Nov 18, 2024Updated 2 years ago
- Collection Of All Python Notebooks Shared On Twitter☆11Apr 10, 2023Updated 3 years ago
- Arcane Insight is a data analytics project designed to harness the power of SQLMesh & DuckDB to collect, transform, and analyze data from…☆37Jan 23, 2025Updated last year
- Data engineering project using UK Bus Open Data Service (BODS) to calculate late buses in real-time for any selected region in England. P…☆33Apr 2, 2023Updated 3 years ago
- ☆20Mar 11, 2025Updated last year
- A tool to fix your bad AI art☆11Aug 26, 2026Updated 2 months ago
- ☆14Jan 9, 2020Updated 6 years ago
- A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract d…☆24Nov 22, 2021Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆14Jan 30, 2023Updated 3 years ago
- resources to create an environment to experiement with Iceberg using Flink, Spark, and Dremio☆10Oct 11, 2023Updated 3 years ago
- The Godot 4 Beginners card game example☆13Jul 28, 2025Updated last year
- AWS IoT Services sample codes. these will be used in AWS IoT hands-on/workshops in Japan.☆11Jan 14, 2021Updated 5 years ago
- ☆16Apr 26, 2024Updated 2 years ago
- ☆16Aug 22, 2022Updated 4 years ago
- Generate proxy versions of cards/decks you are interested in purchasing!☆17May 18, 2025Updated last year
- Welcome to my data engineering projects repository! Here you will find a collection of data engineering projects that I have worked on.☆27Apr 27, 2023Updated 3 years ago
- Learn Spanish conjugation the easy way☆18Aug 16, 2016Updated 10 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This is a custom project for WGU, the original project repo is https://github.com/udacity/nd0821-c2-build-model-workflow-starter☆14Feb 1, 2026Updated 9 months ago
- ☆21May 17, 2025Updated last year
- A simple script for backing up your favorite YouTube channels.☆12Jan 27, 2024Updated 2 years ago
- Sample code for building a Python application for Apache Flink on Kinesis Data Analytics.☆14Sep 1, 2026Updated 2 months ago
- Mapping a codebase to LLMs☆13Apr 20, 2026Updated 6 months ago
- Obsidian plugin to apply spaced repetition to incrementally develop your notes.☆22Oct 9, 2026Updated last month
- ☆14Jan 3, 2020Updated 6 years ago
Are these results useful?