Welcome to my data engineering projects repository! Here you will find a collection of data engineering projects that I have worked on.
☆25Apr 27, 2023Updated 3 years ago
Alternatives and similar repositories for data-engineering-projects
Users that are interested in data-engineering-projects are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Data Engineering Project that implements an ETL data pipeline using Dagster, Apache Spark, Streamlit, MinIO, Metabase, Dbt, Polars, Doc…☆25Nov 19, 2024Updated last year
- ☆12Feb 23, 2022Updated 4 years ago
- Sample Project to Learn Data Engineering☆10Aug 1, 2021Updated 5 years ago
- Data pipeline to build a data warehouse on Postgres☆15Aug 11, 2024Updated 2 years ago
- The infomations☆10Aug 23, 2026Updated last month
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆13Mar 5, 2023Updated 3 years ago
- In this project I have built etl pipline which scraps the trending repository based on month,week and day LIVE extract other related info…☆12Sep 9, 2023Updated 3 years ago
- 🌟 An end-to-end full-stack data science project, including modelling, MLOps, and data storytelling. ✨☆16Aug 30, 2025Updated last year
- This app is designed to assist applicants in searching for potential jobs and to help recruiters find talented candidates.☆15Feb 16, 2025Updated last year
- Business Intelligence and Data Warehousing Project☆13Dec 4, 2019Updated 6 years ago
- Spark Structured Streaming data pipeline that processes movie ratings data in real-time.☆14Updated this week
- Personal Data Engineering Projects☆1,037Feb 8, 2023Updated 3 years ago
- ☆12Mar 6, 2021Updated 5 years ago
- Get Crypto data from API, stream it to Kafka with Airflow. Write data to MySQL and visualize with Metabase☆17Oct 2, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This is an analytical project done using python to process and extract valuable insights from WhatsApp text file, deployed as a webapp us…☆19Dec 8, 2023Updated 2 years ago
- ☆18Jul 9, 2019Updated 7 years ago
- StarCraft 2 Data Pipeline with Airflow, DuckDB and Streamlit☆17Mar 14, 2024Updated 2 years ago
- Source Code for 'Azure Data Factory' by Example by Richard Swinbank☆18Jun 21, 2021Updated 5 years ago
- Fivetran's Jira source dbt package☆15Oct 1, 2025Updated 11 months ago
- This repository contains code and configuration files for an Extract, Transform, Load (ETL) project using Google Cloud Data Fusion for da…☆21Feb 23, 2024Updated 2 years ago
- ☆20Mar 11, 2025Updated last year
- An ETL Orchestration using Apache Airflow to extract CSV files from a Google Drive, validate, transform, and load into a PostgreSQL datab…☆28Jun 30, 2024Updated 2 years ago
- This extension makes vscode seamlessly work with dbt and bigquery☆15Sep 27, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Try to code some algorithms☆17Apr 3, 2025Updated last year
- Formação Engenheiro de Dados Cloud e Big Data (Azure & DataBricks)☆18Oct 31, 2023Updated 2 years ago
- Designed and implemented a Task Management Application using React, Node.js, Express.js, and MongoDB. Key features include secure JWT aut…☆12Dec 7, 2024Updated last year
- ☆13May 19, 2023Updated 3 years ago
- Static Fire is an engine for creating static websites, primarily blogs.☆16Jan 22, 2024Updated 2 years ago
- End-to-end ELT data engineering project☆23Dec 24, 2022Updated 3 years ago
- velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…☆21Aug 12, 2025Updated last year
- an end-to-end data pipeline extracting music listening habits and producing an insightful dashboard☆17Mar 31, 2024Updated 2 years ago
- ☆14Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆34May 5, 2025Updated last year
- Telegram бот-планировщик задач с использованием aiogram, celery, Redis, SQLite.☆16Mar 15, 2023Updated 3 years ago
- PDF AI Assistant Powered By Genimi☆12Mar 24, 2024Updated 2 years ago
- ☆15Feb 18, 2022Updated 4 years ago
- Part-of-Speech Tagger for Russian language☆23Jul 29, 2020Updated 6 years ago
- This project demonstrates how to build and automate an ETL pipeline written in Python and schedule it using open source Apache Airflow or…☆24Aug 21, 2025Updated last year
- https://phohoccode.github.io/Watch-movies/index.html☆10Apr 23, 2024Updated 2 years ago