Alternatives and similar repositories for Data-Engineering:

Users that are interested in Data-Engineering are comparing it to the libraries listed below

• ArpiteshSrivastava / spotify-data-engineering-project
  In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…
  ☆21Updated last year
• JesusAcuna / data-engineering-project
  ☆28Updated last year
• airscholar / realtime-voting-data-engineering
  This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…
  ☆34Updated last year
• josephmachado / python_essentials_for_data_engineers
  Code for blog at https://www.startdataengineering.com/post/python-for-de/
  ☆65Updated 8 months ago
• im-nsk / Building-an-Automated-Weather-Data-Pipeline-with-Airflow-From-Ingestion-to-Data-Warehouse
  This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeath…
  ☆21Updated last year
• sidharth1805 / Spotify_etl
  ☆135Updated 2 years ago
• darshilparmar / twitter-airflow-data-engineering-project
  YouTube tutorial project
  ☆99Updated last year
• itversity / data-engineering-spark
  ☆87Updated 2 years ago
• manuel-lang / Data-Engineering-Nanodegree
  Solution to all projects of Udacity's Data Engineering Nanodegree: Data Modeling with Postgres & Cassandra, Data Warehouse with Redshift,…
  ☆56Updated 2 years ago
• josephmachado / adv_data_transformation_in_sql
  Code for "Advanced data transformations in SQL" free live workshop
  ☆72Updated 4 months ago
• AuFeld / Data_Engineering_Projects
  A collection of data engineering projects: data modeling, ETL pipelines, data lakes, infrastructure configuration on AWS, data warehousin…
  ☆14Updated 3 years ago
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆139Updated 4 years ago
• Lal4Tech / Data-Engineering-With-AWS
  Resources and projects from Udacity Data Engineering with AWS nano degree programme
  ☆25Updated last year
• AnandDedha / aws-airflow-dataengineering-pipeline
  ☆19Updated last year
• supratim94336 / DataEngineeringCapstoneProject
  😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS
  ☆43Updated 5 years ago
• priye-1 / Real_time_End_to_End_Pipeline_using_Kafka
  ☆19Updated last year
• josephmachado / online_store
  End to end data engineering project
  ☆53Updated 2 years ago
• ABZ-Aaron / coincap-api-pipeline
  A simple pipeline utilising cron, Postgres, AWS EC2, and Metabase
  ☆11Updated 7 months ago
• ABZ-Aaron / data-engineer-zoomcamp
  I'm partaking in a Data Engineering Bootcamp / Zoomcamp. I'll store files and progress here.
  ☆102Updated 2 years ago
• SebasMBK / SunglassesHubETL
  This project is for demonstrating knowledge of Data Engineering tools and concepts and also learning in the process
  ☆46Updated 2 years ago
• zkan / dtc-data-engineering-zoomcamp-project
  DataTalks.Club's Data Engineering Zoomcamp Project
  ☆22Updated 2 years ago
• VicenteYago / steam-data-engineering
  A data engineering project with Airflow, dbt, Terrafrom, GCP and much more!
  ☆23Updated 2 years ago
• andrem8 / surf_dash
  ☆149Updated 2 years ago
• shivampanicker / cicd_with_databricks
  ☆30Updated 2 months ago
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆179Updated last year
• MarcosMJD / ghcn-d
  Data Pipeline from the Global Historical Climatology Network DataSet
  ☆26Updated 2 years ago
• priye-1 / airflow_data_pipeline
  ☆16Updated last year
• GrzegorzGatkowski / Air_Pollution_Pipeline
  Data Engineering Project in GCP
  ☆18Updated last year
• vedanthv / data-engineering-portfolio
  Cool DE Projects
  ☆22Updated last month
• josephmachado / de_project
  Step by step instructions to create a production-ready data pipeline
  ☆39Updated 2 months ago