This is a template you can use for your next data engineering portfolio project.
☆192Sep 10, 2021Updated 4 years ago
Alternatives and similar repositories for data-engineering-project-template
Users that are interested in data-engineering-project-template are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The best place to learn data engineering. Built and maintained by the data engineering community.☆2,017Jul 30, 2026Updated last month
- Personal Data Engineering Projects☆1,031Feb 8, 2023Updated 3 years ago
- An Awesome List of Open-Source Data Engineering Projects☆3,272Oct 4, 2024Updated last year
- Data Engineering YouTube Analysis Project by Darshil Parmar☆252Dec 8, 2023Updated 2 years ago
- A data engineering project with Airflow, dbt, Terrafrom, GCP and much more!☆28Nov 8, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A template repository to create a data project with IAC, CI/CD, Data migrations, & testing☆300Jul 11, 2024Updated 2 years ago
- ☆17Sep 4, 2025Updated 11 months ago
- Demo running DBT as a Databricks Workflow task☆13Nov 13, 2024Updated last year
- A batch Data Pipeline that retrieves data from a user purchase table and a movie review table and is transformed to form a user behaviour…☆18Aug 14, 2025Updated last year
- YouTube tutorial project☆110Oct 17, 2023Updated 2 years ago
- For this project I am creating an ETL (Extract, Transform, and Load) pipeline using Python, RegEx, and SQL Database. The goal is to retri…☆26Feb 9, 2021Updated 5 years ago
- Udacity Data Engineering Nanodegree Capstone Project☆36May 9, 2020Updated 6 years ago
- Example end to end data engineering project.☆1,429Dec 8, 2022Updated 3 years ago
- This repo is for the Linkedin Learning course: End-to-End Data Engineering Project☆38Nov 9, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- This Repo contains Jupyter Notebooks to recap on RDD, DataFrame, Spark Streaming and ML operations using Pyspark☆11Nov 3, 2024Updated last year
- Practical Data Engineering: A Hands-On Real-Estate Project Guide☆821Jun 25, 2026Updated 2 months ago
- Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow☆167Jun 16, 2020Updated 6 years ago
- Data Engineering Practice Problems☆2,852Jan 8, 2025Updated last year
- This is a simple analytic project using DuckDB & dbt with air quality data.☆26Feb 21, 2024Updated 2 years ago
- Classwork projects and home works done through Udacity data engineering nano degree☆10Jun 6, 2021Updated 5 years ago
- A collection of data engineering projects: data modeling, ETL pipelines, data lakes, infrastructure configuration on AWS, data warehousin…☆15Apr 29, 2021Updated 5 years ago
- More than 2000+ Data engineer interview questions.☆1,721Jan 13, 2026Updated 7 months ago
- DuckDB with Dashboarding tools demo evidence, streamlit and rill☆23Dec 18, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Data engineering mentorship program☆296Aug 2, 2024Updated 2 years ago
- Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here 👇🏼☆45,083Updated this week
- Practice your Pyspark skills!☆112Oct 22, 2021Updated 4 years ago
- Capstone Project for DataExpert.io V4 Cohort☆14Jul 8, 2024Updated 2 years ago
- Implementing best practices for PySpark ETL jobs and applications.☆2,118Jan 1, 2023Updated 3 years ago
- Learn how Python powers real data engineering. Build end-to-end pipelines from scratch with fully working code and step-by-step video wal…☆110Jul 8, 2026Updated last month
- Beginner data engineering project - batch edition☆591Apr 13, 2026Updated 4 months ago
- Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake developme…☆1,971Aug 26, 2022Updated 4 years ago
- Template for Data Engineering and Data Pipeline projects☆120Jan 1, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A project portfolio to accompany my resume☆30Sep 5, 2023Updated 2 years ago
- ☆18Updated this week
- An e2e pipeline using dlt, dagster, duckdb, and dbt-core☆24Mar 27, 2026Updated 5 months ago
- A list of useful resources to learn Data Engineering from scratch☆4,010Jun 19, 2024Updated 2 years ago
- ☆26Nov 6, 2024Updated last year
- Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR☆92Jul 17, 2019Updated 7 years ago
- This project involves an ETL (Extract, Transform, Load) process to analyze sleep data exported from Apple Health☆29Apr 29, 2023Updated 3 years ago