Alternatives and similar repositories for data-engineering-projects

Users that are interested in data-engineering-projects are comparing it to the libraries listed below

• HamzaG737 / data-engineering-project
  End to end data engineering project with kafka, airflow, spark, postgres and docker.
  ☆107Updated 9 months ago
• airscholar / e2e-data-engineering
  An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Ka…
  ☆303Updated 10 months ago
• darshilparmar / uber-etl-pipeline-data-engineering-project
  ☆312Updated last year
• airscholar / RedditDataEngineering
  This project provides a comprehensive data pipeline solution to extract, transform, and load (ETL) Reddit data into a Redshift data wareh…
  ☆183Updated 2 years ago
• andrem8 / surf_dash
  ☆162Updated 3 years ago
• darshilparmar / twitter-airflow-data-engineering-project
  YouTube tutorial project
  ☆105Updated 2 years ago
• Lal4Tech / Data-Engineering-With-AWS
  Resources and projects from Udacity Data Engineering with AWS nano degree programme
  ☆28Updated 2 years ago
• darshilparmar / dataengineering-youtube-analysis-project
  Data Engineering YouTube Analysis Project by Darshil Parmar
  ☆213Updated 2 years ago
• subhamkharwal / pyspark-zero-to-hero
  Learn PySpark from Basics to Advanced. Checkout the YouTube Series : [PySpark - Zero to Hero]
  ☆118Updated 4 months ago
• afaqueahmad7117 / spark-experiments
  Ultimate guide for mastering Spark Performance Tuning and Optimization concepts and for preparing for Data Engineering interviews
  ☆188Updated last week
• RSKriegs / finnhub-streaming-data-pipeline
  Stream processing pipeline from Finnhub websocket using Spark, Kafka, Kubernetes and more
  ☆370Updated 2 years ago
• Joshua-omolewa / Retailstore_ETL_pipeline_project
  Built a Data Pipeline for a Retail store using AWS services that collects data from its transactional database (OLTP) in Snowflake and tr…
  ☆11Updated 2 years ago
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆160Updated 5 years ago
• kroudir / Data-Engineer-Nanodegree-Projects-Udacity
  Projects done in the Data Engineer Nanodegree Program by Udacity.com
  ☆164Updated 3 years ago
• sidharth1805 / Spotify_etl
  ☆147Updated 2 years ago
• uhussain / WebCrawlerForInflation
  Price Crawler - Tracking Price Inflation
  ☆189Updated 5 years ago
• darshilparmar / stock-market-kafka-data-engineering-project
  ☆210Updated 2 years ago
• darshilparmar / python-for-data-engineering
  This repo contains all the code used in the Python for Data Engineering Course
  ☆328Updated last year
• shafiab / HashtagCashtag
  My Insight Data Engineering Fellowship project. I implemented a big data processing pipeline based on ​lambda architecture​, that aggrega…
  ☆505Updated 3 years ago
• josephmachado / sde_de101_josephmachado
  Sample repo for startdataengineering DE 101 free course
  ☆72Updated last year
• darshilparmar / apache-spark-with-data-bricks-for-data-engineering
  apache-spark-with-databricks-for-data-engineering
  ☆97Updated last year
• ankurchavda / streamify
  A data engineering project with Kafka, Spark Streaming, dbt, Docker, Airflow, Terraform, GCP and much more!
  ☆818Updated 3 years ago
• immu0001 / Udacity-Data-Engineer-nanodegree
  Classwork projects and home works done through Udacity data engineering nano degree
  ☆75Updated 2 years ago
• ABZ-Aaron / data-engineer-zoomcamp
  I'm partaking in a Data Engineering Bootcamp / Zoomcamp. I'll store files and progress here.
  ☆109Updated 3 years ago
• ArpiteshSrivastava / spotify-data-engineering-project
  In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…
  ☆25Updated 2 years ago
• airscholar / realtime-voting-data-engineering
  This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…
  ☆45Updated 2 years ago
• PacktPublishing / Data-Engineering-with-Python
  Data Engineering with Python, published by Packt
  ☆772Updated 2 years ago
• ortizfram / datacamp-Data-Engineer-with-Python-course
  datacamp Data Engineer with Python course. 73 hours/ 19 Courses /2 Skill Assessments
  ☆134Updated 3 years ago
• ziritrion / dataeng-zoomcamp
  ☆361Updated 2 years ago
• ajupton / big-data-engineering-project
  Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR
  ☆88Updated 6 years ago