Alternatives and similar repositories for data-engineering

Users that are interested in data-engineering are comparing it to the libraries listed below

• immu0001 / Udacity-Data-Engineer-nanodegree
  Classwork projects and home works done through Udacity data engineering nano degree
  ☆74Updated last year
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆41Updated 11 months ago
• itversity / data-engineering-spark
  ☆87Updated 2 years ago
• damklis / etljob
  Simple ETL pipeline using Python
  ☆26Updated 2 years ago
• josephmachado / online_store
  End to end data engineering project
  ☆56Updated 2 years ago
• JesusAcuna / data-engineering-project
  ☆28Updated last year
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆55Updated 2 years ago
• supratim94336 / DataEngineeringCapstoneProject
  😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS
  ☆48Updated 5 years ago
• danieldiamond / data-engineering-capstone
  Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development
  ☆21Updated 5 years ago
• martandsingh / ApacheSpark
  This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…
  ☆99Updated 11 months ago
• hyunjoonbok / PySpark
  PySpark functions and utilities with examples. Assists ETL process of data modeling
  ☆103Updated 4 years ago
• jackgisby / tfl-bikes-data-pipeline
  Processing TfL data for bike usage with Google Cloud Platform.
  ☆45Updated 2 years ago
• mharty3 / energy_data_capstone
  ☆35Updated 2 years ago
• zacharyt-cs / reddit-data-engineering
  An end-to-end data engineering pipeline to create a dashboard for the latest content on the r/Stocks subreddit
  ☆19Updated 2 years ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆102Updated last year
• zkan / dtc-data-engineering-zoomcamp-project
  DataTalks.Club's Data Engineering Zoomcamp Project
  ☆23Updated 2 years ago
• IremErturk / dtc-de-capstone-project
  ☆11Updated 3 years ago
• airscholar / modern-data-eng-dbt-databricks-azure
  In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …
  ☆32Updated last year
• HoracioSoldman / batch-processing-on-aws
  With everything I learned from DEZoomcamp from datatalks.club, this project performs a batch processing on AWS for the cycling dataset wh…
  ☆14Updated 3 years ago
• VicenteYago / steam-data-engineering
  A data engineering project with Airflow, dbt, Terrafrom, GCP and much more!
  ☆25Updated 2 years ago
• dogukannulu / csv_extract_airflow_docker
  Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.
  ☆36Updated last year
• manuel-lang / Data-Engineering-Nanodegree
  Solution to all projects of Udacity's Data Engineering Nanodegree: Data Modeling with Postgres & Cassandra, Data Warehouse with Redshift,…
  ☆57Updated 2 years ago
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆147Updated 5 years ago
• ajupton / big-data-engineering-project
  Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR
  ☆84Updated 5 years ago
• josephmachado / e2e_datapipeline_test
  Example repo to create end to end tests for data pipeline.
  ☆25Updated last year
• ddgope / Data-Pipelines-with-Airflow
  This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…
  ☆91Updated 5 years ago
• rohitrsp898 / Basic_ETL_PySpark
  ☆21Updated 2 years ago
• yennanliu / DE-100-days
  data engineering 100 days 🤖 🧲 🦾 | #DE
  ☆39Updated last year
• Wittline / data-engineer-challenge
  Challenge Data Engineer
  ☆25Updated 3 years ago
• sankamuk / PysparkCheatsheet
  PySpark Cheatsheet
  ☆36Updated 2 years ago