Alternatives and similar repositories for Data_Engineering_Projects

Users that are interested in Data_Engineering_Projects are comparing it to the libraries listed below

• im-nsk / Building-an-Automated-Weather-Data-Pipeline-with-Airflow-From-Ingestion-to-Data-Warehouse
  This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeath…
  ☆22Updated 2 years ago
• arverma / TowardsDataEngineering
  This repo contains commands that data engineers use in day to day work.
  ☆61Updated 2 years ago
• zkan / dtc-data-engineering-zoomcamp-project
  DataTalks.Club's Data Engineering Zoomcamp Project
  ☆23Updated 3 years ago
• airscholar / realtime-voting-data-engineering
  This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…
  ☆42Updated last year
• manuel-lang / Data-Engineering-Nanodegree
  Solution to all projects of Udacity's Data Engineering Nanodegree: Data Modeling with Postgres & Cassandra, Data Warehouse with Redshift,…
  ☆57Updated 3 years ago
• shravan-kuchkula / udacity-data-eng-proj4
  Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as …
  ☆16Updated 6 years ago
• damklis / etljob
  Simple ETL pipeline using Python
  ☆28Updated 2 years ago
• MartyC-137 / Data-Engineering
  A project portfolio to accompany my resume
  ☆29Updated 2 years ago
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆157Updated 5 years ago
• Wittline / uber-expenses-tracking
  The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such …
  ☆122Updated 3 years ago
• ArpiteshSrivastava / spotify-data-engineering-project
  In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…
  ☆25Updated 2 years ago
• BenSchr / Udacity-Data-Engineering-Projects
  My solutions for the Udacity Data Engineering Nanodegree
  ☆34Updated 6 years ago
• darshilparmar / twitter-airflow-data-engineering-project
  YouTube tutorial project
  ☆105Updated 2 years ago
• rafik-rahoui / End-to-end-data-enginnerring-project
  End-to-end ELT data engineering project
  ☆22Updated 2 years ago
• jacob1421 / RustCheatersDataPipeline
  Data pipeline that scrapes Rust cheater Steam profiles
  ☆54Updated 3 years ago
• sankamuk / PysparkCheatsheet
  PySpark Cheatsheet
  ☆36Updated 2 years ago
• JesusAcuna / data-engineering-project
  ☆29Updated 2 years ago
• hyunjoonbok / PySpark
  PySpark functions and utilities with examples. Assists ETL process of data modeling
  ☆104Updated 4 years ago
• josephmachado / online_store
  End to end data engineering project
  ☆57Updated 3 years ago
• itversity / data-engineering-spark
  ☆88Updated 3 years ago
• rohitrsp898 / Basic_ETL_PySpark
  ☆21Updated 2 years ago
• HamzaG737 / data-engineering-project
  End to end data engineering project with kafka, airflow, spark, postgres and docker.
  ☆105Updated 7 months ago
• martandsingh / ApacheSpark
  This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…
  ☆103Updated last month
• LinkedInLearning / end-to-end-data-engineering-project-4413618
  This repo is for the Linkedin Learning course: End-to-End Data Engineering Project
  ☆25Updated 2 years ago
• immu0001 / Udacity-Data-Engineer-nanodegree
  Classwork projects and home works done through Udacity data engineering nano degree
  ☆74Updated last year
• zacharyt-cs / reddit-data-engineering
  An end-to-end data engineering pipeline to create a dashboard for the latest content on the r/Stocks subreddit
  ☆19Updated 3 years ago
• HoracioSoldman / batch-processing-on-aws
  With everything I learned from DEZoomcamp from datatalks.club, this project performs a batch processing on AWS for the cycling dataset wh…
  ☆14Updated 3 years ago
• ajupton / big-data-engineering-project
  Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR
  ☆88Updated 6 years ago
• SourabhSinghRana / real-time_crypto_data_pipeline_using_kafka
  I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that uti…
  ☆30Updated 2 years ago
• ismaildawoodjee / aws-data-pipeline
  A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…
  ☆23Updated 3 years ago