Some example projects for Data Engineers to build, end-to-end.
☆39Nov 8, 2023Updated 2 years ago
Alternatives and similar repositories for DataEngineeringProjects
Users that are interested in DataEngineeringProjects are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Data pipeline to build a data warehouse on Postgres☆16Aug 11, 2024Updated 2 years ago
- This is the end to end MLOps project I built through participated the MLOps Zoomcamp☆10Sep 11, 2022Updated 4 years ago
- A repo to track data engineering projects☆14Nov 11, 2022Updated 3 years ago
- Template for Data Engineering and Data Pipeline projects☆119Jan 1, 2023Updated 3 years ago
- ☆12Jul 4, 2021Updated 5 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- End to end data engineering project☆59Oct 27, 2022Updated 4 years ago
- Built a stream processing data pipeline to get data from disparate systems into a dashboard using Kafka as an intermediary.☆29Aug 14, 2023Updated 3 years ago
- End-to-end data platform leveraging the Modern data stack☆53Apr 10, 2024Updated 2 years ago
- how to unit test your PySpark code☆29Mar 26, 2021Updated 5 years ago
- This is a collecton of Amazon CDK projects to show how to directly ingest streaming data from Amazon Mananged Service for Apache Kafka (M…☆16Jul 28, 2026Updated 3 months ago
- A Python integration for Nintento Parental Controls☆16Oct 9, 2026Updated 2 weeks ago
- Databricks CI/CD using Azure DevOps☆21Nov 1, 2022Updated 3 years ago
- Simulate SDTM datasets in SAS.☆12Jan 19, 2018Updated 8 years ago
- Get Crypto data from API, stream it to Kafka with Airflow. Write data to MySQL and visualize with Metabase☆17Oct 2, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Arcane Insight is a data analytics project designed to harness the power of SQLMesh & DuckDB to collect, transform, and analyze data from…☆37Jan 23, 2025Updated last year
- Code repo for mapping tool that allows users to play with components of composite indexed indicator, such as social vulnerability.☆12Dec 3, 2022Updated 3 years ago
- Fundamentals of Apache Flink [video], published by Packt☆12Jan 30, 2023Updated 3 years ago
- Interactive donut maps☆20Apr 2, 2021Updated 5 years ago
- This project focuses on generating a diverse and realistic dataset for computer vision training using ChatGPT and a realistic vision imag…☆13Dec 15, 2023Updated 2 years ago
- An open-source framework designed to extend and maintain the ESCO taxonomy☆19Mar 12, 2026Updated 7 months ago
- Explorative Data Analysis Guidelines☆23Sep 10, 2024Updated 2 years ago
- ☆16Aug 22, 2022Updated 4 years ago
- Streamlining Data Access in Clinical Research☆23Oct 22, 2026Updated last week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- The Godot 4 Beginners card game example☆14Jul 28, 2025Updated last year
- Using DuckDB with AWS Lambda to process Delta Lake data☆34Jan 26, 2025Updated last year
- Presentations, code and solutions for the geocompr workshop at GeoStats 2018☆15Sep 7, 2018Updated 8 years ago
- A simple script for backing up your favorite YouTube channels.☆12Jan 27, 2024Updated 2 years ago
- ☆16Apr 26, 2024Updated 2 years ago
- Outlier Detection with AI + ML☆16Sep 12, 2025Updated last year
- An R package for the spatial implementation of Bayesian Network in R and more☆24Aug 17, 2020Updated 6 years ago
- ☆26Oct 21, 2026Updated last week
- Get historical dividends, splits, capital gains distributions, and prices for a set of symbols from Yahoo Finance☆12Dec 23, 2025Updated 10 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆26Sep 29, 2026Updated last month
- Code for data quality with greatexpectations blog☆14Jul 30, 2024Updated 2 years ago
- Javascript client-side FIT file analyzer.☆11Nov 15, 2019Updated 6 years ago
- Simplify Big Data Analytics with Amazon EMR, published by Packt☆13Jan 18, 2023Updated 3 years ago
- Obsidian plugin to apply spaced repetition to incrementally develop your notes.☆22Oct 9, 2026Updated 2 weeks ago
- ☆14Jan 3, 2020Updated 6 years ago
- Advanced Spark SQL for Data Engineers☆14Jun 21, 2025Updated last year