Alternatives and similar repositories for data-engineering

Users that are interested in data-engineering are comparing it to the libraries listed below

• natbusa / data-engineering
  How to build an awesome data engineering team
  ☆100Updated 5 years ago
• InsightDataScience / Awesome-Data-Engineering-Content
  Sharing interesting and noteworthy Data Engineering content
  ☆68Updated 8 years ago
• yennanliu / DE-100-days
  data engineering 100 days 🤖 🧲 🦾 | #DE
  ☆39Updated last year
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆55Updated 2 years ago
• iam-mhaseeb / Skytrax-Data-Warehouse
  A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for …
  ☆137Updated 5 years ago
• aravindr18 / RedditR--Insight-Data-Engineering-Project
  RedditR for Content Engagement and Recommendation
  ☆21Updated 7 years ago
• umer7 / Data-Warehouse-Concepts-Design-and-Data-Integration
  Repo for Data Warehouse Concepts, Design, and Data Integration by University of Colorado System (coursera)(Notes,Assignments, quiz and r…
  ☆44Updated 7 years ago
• kislerdm / data-engineering-interviews
  Data engineering interviews Q&A for data community by data community
  ☆63Updated 5 years ago
• chandra1sekar / data-engineering
  ☆31Updated 6 years ago
• immu0001 / Udacity-Data-Engineer-nanodegree
  Classwork projects and home works done through Udacity data engineering nano degree
  ☆74Updated last year
• ananthdurai / airflow-training
  Airflow training for the crunch conf
  ☆105Updated 6 years ago
• arverma / TowardsDataEngineering
  This repo contains commands that data engineers use in day to day work.
  ☆61Updated 2 years ago
• jamesbyars / apache-spark-etl-pipeline-example
  Demonstration of using Apache Spark to build robust ETL pipelines while taking advantage of open source, general purpose cluster computin…
  ☆25Updated last year
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆102Updated last year
• vivek-bombatkar / Spark-with-Python---My-learning-notes-
  ETL pipeline using pyspark (Spark - Python)
  ☆117Updated 5 years ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆77Updated 2 years ago
• Pushkr / Apache-Spark-Hands-On
  Educational notes,Hands on problems w/ solutions for hadoop ecosystem
  ☆87Updated 6 years ago
• itversity / data-engineering-spark
  ☆87Updated 2 years ago
• dimajix / spark-training
  Repository used for Spark Trainings
  ☆53Updated 2 years ago
• RichardAfolabi / Realtime-Data-Analytics-Using-Spark
  Realtime social media data analytics with Apache Spark, Python, Kafka, Pandas, etc
  ☆51Updated 8 years ago
• ddgope / Data-Pipelines-with-Airflow
  This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…
  ☆91Updated 5 years ago
• yennanliu / NYC_Taxi_Pipeline
  Design/Implement stream/batch architecture on NYC taxi data | #DE
  ☆25Updated 4 years ago
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆147Updated 5 years ago
• josephmachado / bitcoinMonitor
  Near real time ETL to populate a dashboard.
  ☆72Updated last year
• mikeroyal / Apache-Spark-Guide
  Apache Spark Guide
  ☆31Updated 3 years ago
• Data-Engineering-Weekly / dataengineeringweekly
  Weekly Data Engineering Newsletter
  ☆96Updated 11 months ago
• marcosmarxm / airflow-testing-ci-workflow
  (project & tutorial) dag pipeline tests + ci/cd setup
  ☆88Updated 4 years ago
• josephwibowo / MeetBaeArea
  Airflow ETL for Meetup API
  ☆46Updated 6 years ago
• Sean-Bradley / Stream-Data-From-Flask-To-Postgres
  A tutorial on streaming data from a Flask REST API and streaming the response into PostgreSQL
  ☆39Updated 5 years ago
• flpezet / analytics-readings
  Readings for Analytics Engineers
  ☆249Updated 2 years ago