Welcome to my data engineering projects repository! Here you will find a collection of data engineering projects that I have worked on.
☆26Apr 27, 2023Updated 3 years ago
Alternatives and similar repositories for data-engineering-projects
Users that are interested in data-engineering-projects are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆12Feb 23, 2022Updated 4 years ago
- Sample Project to Learn Data Engineering☆10Aug 1, 2021Updated 5 years ago
- Data pipeline to build a data warehouse on Postgres☆16Aug 11, 2024Updated 2 years ago
- NoSQL extract, transform, load (ETL) toolkit with Python☆16Updated this week
- The infomations☆10Aug 23, 2026Updated last month
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆13Mar 5, 2023Updated 3 years ago
- In this project I have built etl pipline which scraps the trending repository based on month,week and day LIVE extract other related info…☆12Sep 9, 2023Updated 3 years ago
- Business Intelligence and Data Warehousing Project☆13Dec 4, 2019Updated 6 years ago
- This is an analytical project done using python to process and extract valuable insights from WhatsApp text file, deployed as a webapp us…☆19Dec 8, 2023Updated 2 years ago
- Guides☆10Jan 18, 2024Updated 2 years ago
- Example of a Streamlit data app powered by Vaex☆11Jul 7, 2022Updated 4 years ago
- Integrating Apache Airflow, dbt, Great Expectations and Apache Superset to develop a modern open source data stack.☆19Jun 19, 2022Updated 4 years ago
- StarCraft 2 Data Pipeline with Airflow, DuckDB and Streamlit☆17Mar 14, 2024Updated 2 years ago
- Fivetran's Jira source dbt package☆15Oct 1, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆11May 22, 2026Updated 4 months ago
- ☆14Nov 11, 2023Updated 2 years ago
- This repository contains code and configuration files for an Extract, Transform, Load (ETL) project using Google Cloud Data Fusion for da…☆21Feb 23, 2024Updated 2 years ago
- ☆12Jul 5, 2021Updated 5 years ago
- A dataset for Movie Recommendation with NebulaGraph, ETL to merge two dataset: OMDB & Movielens with dbt, postgres and Nebula-Importer☆17Sep 7, 2024Updated 2 years ago
- This extension makes vscode seamlessly work with dbt and bigquery☆15Sep 27, 2022Updated 4 years ago
- Try to code some algorithms☆17Apr 3, 2025Updated last year
- Formação Engenheiro de Dados Cloud e Big Data (Azure & DataBricks)☆18Oct 31, 2023Updated 2 years ago
- ☆10Feb 27, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- This repo contains all the code, slides and other reference documents used in community sessions.☆14Mar 29, 2023Updated 3 years ago
- ☆13May 19, 2023Updated 3 years ago
- End-to-end ELT data engineering project☆23Dec 24, 2022Updated 3 years ago
- an end-to-end data pipeline extracting music listening habits and producing an insightful dashboard☆17Mar 31, 2024Updated 2 years ago
- ☆14Oct 5, 2026Updated last week
- ☆34May 5, 2025Updated last year
- This project aims to use a convolutional neural network (CNN) to classify 7 classes of skin lesions.☆18Nov 22, 2022Updated 3 years ago
- PDF AI Assistant Powered By Genimi☆12Mar 24, 2024Updated 2 years ago
- These are the fresh-grad hiring interview questions that were accumulated through interviewees over the past two years.☆23Oct 4, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- End to end data engineering project with kafka, airflow, spark, postgres and docker.☆120Jan 8, 2026Updated 9 months ago
- Skooldio: Data Pipelines with Airflow☆23May 24, 2025Updated last year
- System Design, Solution Architecture, Data Systems Practice☆85Aug 14, 2025Updated last year
- Automate process to change image background using Amazon Bedrock and AWS Step Functions☆16Aug 12, 2024Updated 2 years ago
- Hand Dino Game OpenCV Python☆13Feb 19, 2020Updated 6 years ago
- Exercises & Notes from the LinkedIn Learning courses about Behavioral, Creational & Structural Design Patterns by Bethan Palmer☆19Jun 7, 2025Updated last year
- Labs and demos for courses in the Data Engineer track of GCP Training (http://cloud.google.com/training).☆15Oct 28, 2019Updated 6 years ago