Some example projects for Data Engineers to build, end-to-end.
☆39Nov 8, 2023Updated 2 years ago
Alternatives and similar repositories for DataEngineeringProjects
Users that are interested in DataEngineeringProjects are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A repo to track data engineering projects☆14Nov 11, 2022Updated 3 years ago
- Python functions to obtain and clean data required for the version 2 Housing Unit Allocation. Workflow uses Census API.☆20May 25, 2026Updated 2 months ago
- This is a collecton of Amazon CDK projects to show how to directly ingest streaming data from Amazon Mananged Service for Apache Kafka (M…☆16Jul 28, 2026Updated last week
- End-to-end data platform leveraging the Modern data stack☆52Apr 10, 2024Updated 2 years ago
- how to unit test your PySpark code☆29Mar 26, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Built a stream processing data pipeline to get data from disparate systems into a dashboard using Kafka as an intermediary.☆29Aug 14, 2023Updated 2 years ago
- ☆20Jan 23, 2023Updated 3 years ago
- Data Engineering Practice Problems☆2,820Jan 8, 2025Updated last year
- Data Engineering Project to Extract and Process Solana Reddit Data☆40Feb 3, 2024Updated 2 years ago
- Data engineering project using UK Bus Open Data Service (BODS) to calculate late buses in real-time for any selected region in England. P…☆32Apr 2, 2023Updated 3 years ago
- ☆14Aug 6, 2023Updated 3 years ago
- small shiny app to understand various to correct geometries☆12Dec 11, 2022Updated 3 years ago
- ☆19May 22, 2026Updated 2 months ago
- Reproduce "Geofaceting -- align small-multiples for regions in a spatially meaningful way"☆13Jan 22, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Code repo for mapping tool that allows users to play with components of composite indexed indicator, such as social vulnerability.☆12Dec 3, 2022Updated 3 years ago
- Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as …☆17Oct 1, 2019Updated 6 years ago
- Source code for http://freerangestats.info☆19Updated this week
- ☆16Jun 3, 2021Updated 5 years ago
- Stationary Bike "Smart" trainer gaming motivator. Connects to Bluetooth LE smart trainers and disables your game controller if you drop b…☆11Aug 9, 2021Updated 5 years ago
- ☆20Mar 11, 2025Updated last year
- This is a custom project for WGU, the original project repo is https://github.com/udacity/nd0821-c2-build-model-workflow-starter☆14Feb 1, 2026Updated 6 months ago
- Fundamentals of Apache Flink [video], published by Packt☆12Jan 30, 2023Updated 3 years ago
- My dotfiles for macOS and NixOS.☆18Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- An open-source framework designed to extend and maintain the ESCO taxonomy☆18Mar 12, 2026Updated 4 months ago
- A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract d…☆24Nov 22, 2021Updated 4 years ago
- This repository contains the code snippets used in "LLM Prompt Engineering For Developers"☆14Apr 22, 2024Updated 2 years ago
- Using DuckDB with AWS Lambda to process Delta Lake data☆34Jan 26, 2025Updated last year
- Outlier Detection with AI + ML☆16Sep 12, 2025Updated 10 months ago
- A simple script for backing up your favorite YouTube channels.☆12Jan 27, 2024Updated 2 years ago
- Generate proxy versions of cards/decks you are interested in purchasing!☆17May 18, 2025Updated last year
- Presentations, code and solutions for the geocompr workshop at GeoStats 2018☆15Sep 7, 2018Updated 7 years ago
- ☆14Jan 30, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Medieval strategy autobattling deckbuilder. My First Game Jam: Summer 2020.☆17Apr 28, 2021Updated 5 years ago
- Coding with ChatGPT and other LLMs, published by Packt☆16Dec 9, 2024Updated last year
- An R package for the spatial implementation of Bayesian Network in R and more☆24Aug 17, 2020Updated 5 years ago
- Sample code for building a Python application for Apache Flink on Kinesis Data Analytics.☆14Aug 30, 2023Updated 2 years ago
- Clinical trial data analytic recipes in R for SAS users☆30Sep 3, 2024Updated last year
- Simplify Big Data Analytics with Amazon EMR, published by Packt☆13Jan 18, 2023Updated 3 years ago
- ☆14Jan 3, 2020Updated 6 years ago