Alternatives and similar repositories for dataengineering-github-data-pipelineline

Users that are interested in dataengineering-github-data-pipelineline are comparing it to the libraries listed below

• ArpiteshSrivastava / spotify-data-engineering-project
  In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…
  ☆24Updated 2 years ago
• hoe94 / DTC_DE_FinalProject
  This is the final project that after participated the Data Engineering Zoomcamp
  ☆11Updated 3 years ago
• GrzegorzGatkowski / Air_Pollution_Pipeline
  Data Engineering Project in GCP
  ☆21Updated 2 years ago
• uhussain / WebCrawlerForInflation
  Price Crawler - Tracking Price Inflation
  ☆188Updated 5 years ago
• JesusAcuna / data-engineering-project
  ☆29Updated last year
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆156Updated 5 years ago
• airscholar / realtime-voting-data-engineering
  This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…
  ☆41Updated last year
• HamzaG737 / data-engineering-project
  End to end data engineering project with kafka, airflow, spark, postgres and docker.
  ☆103Updated 6 months ago
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆198Updated last year
• josephmachado / online_store
  End to end data engineering project
  ☆57Updated 2 years ago
• Lal4Tech / Data-Engineering-With-AWS
  Resources and projects from Udacity Data Engineering with AWS nano degree programme
  ☆27Updated 2 years ago
• ANelson82 / de_zoomcamp_2022_earthquake_capstone
  ☆18Updated 2 years ago
• c85 / ibm-de-capstone
  Capstone Project for the IBM Data Engineering Professional Certification.
  ☆12Updated 3 years ago
• andrem8 / surf_dash
  ☆160Updated 3 years ago
• damklis / etljob
  Simple ETL pipeline using Python
  ☆28Updated 2 years ago
• AuFeld / Data_Engineering_Projects
  A collection of data engineering projects: data modeling, ETL pipelines, data lakes, infrastructure configuration on AWS, data warehousin…
  ☆15Updated 4 years ago
• josephmachado / data_engineering_project_template
  A template repository to create a data project with IAC, CI/CD, Data migrations, & testing
  ☆279Updated last year
• airscholar / e2e-data-engineering
  An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Ka…
  ☆282Updated 8 months ago
• afaqueahmad7117 / spark-experiments
  Ultimate guide for mastering Spark Performance Tuning and Optimization concepts and for preparing for Data Engineering interviews
  ☆170Updated last month
• zkan / dtc-data-engineering-zoomcamp-project
  DataTalks.Club's Data Engineering Zoomcamp Project
  ☆23Updated 3 years ago
• airscholar / RedditDataEngineering
  This project provides a comprehensive data pipeline solution to extract, transform, and load (ETL) Reddit data into a Redshift data wareh…
  ☆158Updated last year
• sidharth1805 / Spotify_etl
  ☆142Updated 2 years ago
• ayushdixit487 / Uber-Data-Analysis-Project-in-Pyspark
  This data project can be used as a take-home assignment to learn Pyspark and Data Engineering.
  ☆16Updated 2 years ago
• josephmachado / sde_de101_josephmachado
  Sample repo for startdataengineering DE 101 free course
  ☆69Updated last year
• RSKriegs / finnhub-streaming-data-pipeline
  Stream processing pipeline from Finnhub websocket using Spark, Kafka, Kubernetes and more
  ☆365Updated last year
• kroudir / Data-Engineer-Nanodegree-Projects-Udacity
  Projects done in the Data Engineer Nanodegree Program by Udacity.com
  ☆165Updated 2 years ago
• data-engineering-community / data-engineering-project-template
  This is a template you can use for your next data engineering portfolio project.
  ☆182Updated 4 years ago
• darshilparmar / twitter-airflow-data-engineering-project
  YouTube tutorial project
  ☆104Updated 2 years ago
• josephmachado / bitcoinMonitor
  Near real time ETL to populate a dashboard.
  ☆72Updated last month
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆110Updated last year