Welcome to my data engineering projects repository! Here you will find a collection of data engineering projects that I have worked on.
☆24Apr 27, 2023Updated 2 years ago
Alternatives and similar repositories for data-engineering-projects
Users that are interested in data-engineering-projects are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- NoSQL extract, transform, load (ETL) toolkit with Python☆15Apr 4, 2026Updated last week
- Business Intelligence and Data Warehousing Project☆13Dec 4, 2019Updated 6 years ago
- Spark Structured Streaming data pipeline that processes movie ratings data in real-time.☆14Mar 1, 2026Updated last month
- This app is designed to assist applicants in searching for potential jobs and to help recruiters find talented candidates.☆16Feb 16, 2025Updated last year
- XCloud Project's objective is to build similar infrastructure on both AWS and GCP to have multi cloud infrastructure for an organization …☆14Aug 1, 2022Updated 3 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- ☆12Mar 6, 2021Updated 5 years ago
- In this project I have built etl pipline which scraps the trending repository based on month,week and day LIVE extract other related info…☆12Sep 9, 2023Updated 2 years ago
- ☆15Nov 11, 2023Updated 2 years ago
- This repository contains code and configuration files for an Extract, Transform, Load (ETL) project using Google Cloud Data Fusion for da…☆20Feb 23, 2024Updated 2 years ago
- Formação Engenheiro de Dados Cloud e Big Data (Azure & DataBricks)☆18Oct 31, 2023Updated 2 years ago
- ☆13Updated this week
- This repo contains all the code, slides and other reference documents used in community sessions.☆14Mar 29, 2023Updated 3 years ago
- End-to-end ELT data engineering project☆22Dec 24, 2022Updated 3 years ago
- how to unit test your PySpark code☆29Mar 26, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- Static Fire is an engine for creating static websites, primarily blogs.☆16Jan 22, 2024Updated 2 years ago
- PDF AI Assistant Powered By Genimi☆12Mar 24, 2024Updated 2 years ago
- End to end data engineering project with kafka, airflow, spark, postgres and docker.☆110Jan 8, 2026Updated 3 months ago
- Implementation of realworld app backend api☆10Jul 17, 2023Updated 2 years ago
- velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…☆20Aug 12, 2025Updated 8 months ago
- ☆15Feb 18, 2022Updated 4 years ago
- Automate process to change image background using Amazon Bedrock and AWS Step Functions☆16Aug 12, 2024Updated last year
- Skooldio: Data Pipelines with Airflow☆23May 24, 2025Updated 10 months ago
- ☆13May 19, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- ☆16Apr 1, 2024Updated 2 years ago
- A Data Engineering Project that implements an ETL data pipeline using Dagster, Apache Spark, Streamlit, MinIO, Metabase, Dbt, Polars, Doc…☆23Nov 19, 2024Updated last year
- Labs and demos for courses in the Data Engineer track of GCP Training (http://cloud.google.com/training).☆16Oct 28, 2019Updated 6 years ago
- AWS Bedrock agent acting as a Telegram chat assistant.☆17May 5, 2024Updated last year
- Personal Data Engineering Projects☆1,004Feb 8, 2023Updated 3 years ago
- Action for synchronizing a git branch to another location (Bitbucket, GitHub, GitLab, etc.) using SSH.☆14Aug 10, 2022Updated 3 years ago
- Spark and Delta Lake Workshop☆22Jun 14, 2022Updated 3 years ago
- DataTalks.Club's Data Engineering Zoomcamp Project☆24Jul 14, 2022Updated 3 years ago
- The infomations☆10Dec 13, 2025Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- Demonstration of using Apache Spark to build robust ETL pipelines while taking advantage of open source, general purpose cluster computin…☆25Aug 11, 2023Updated 2 years ago
- Curated VulcanSQL show cases☆25Sep 6, 2023Updated 2 years ago
- ML Zoomcamp fall 2021 homework and stuff☆67Feb 18, 2022Updated 4 years ago
- Awesome list for datapipeline☆35Feb 6, 2023Updated 3 years ago
- An informal list of libraries, programs, examples, and benchmarks using the Numba CUDA target☆16Sep 28, 2023Updated 2 years ago
- An End-to-End ETL data pipeline that leverages pyspark parallel processing to process about 25 million rows of data coming from a SaaS ap…☆25Dec 7, 2022Updated 3 years ago
- Open episode of the data engineering practice course☆32Jul 2, 2024Updated last year