Alternatives and similar repositories for airflow-spark-aws-emr:

Users that are interested in airflow-spark-aws-emr are comparing it to the libraries listed below

• supratim94336 / DataEngineeringCapstoneProject
  😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS
  ☆44Updated 5 years ago
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆141Updated 4 years ago
• raveendratal / ravi_azureadbadf
  Ravi Azure ADB ADF Repository
  ☆65Updated last month
• akashmehta10 / profiling_pyspark
  ☆25Updated last year
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆181Updated last year
• HoracioSoldman / batch-processing-on-aws
  With everything I learned from DEZoomcamp from datatalks.club, this project performs a batch processing on AWS for the cycling dataset wh…
  ☆12Updated 2 years ago
• Snowflake-Labs / sfguide-data-engineering-with-snowpark-python
  ☆124Updated last month
• itversity / data-engineering-spark
  ☆87Updated 2 years ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆40Updated 8 months ago
• arverma / TowardsDataEngineering
  This repo contains commands that data engineers use in day to day work.
  ☆60Updated 2 years ago
• sankamuk / PysparkCheatsheet
  PySpark Cheatsheet
  ☆36Updated 2 years ago
• LearningJournal / Apache-Spark-and-Databricks-Stream-Processing-in-Lakehouse
  ☆49Updated last year
• ajupton / big-data-engineering-project
  Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR
  ☆81Updated 5 years ago
• JesusAcuna / data-engineering-project
  ☆27Updated last year
• martandsingh / ApacheSpark
  This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…
  ☆96Updated 7 months ago
• immu0001 / Udacity-Data-Engineer-nanodegree
  Classwork projects and home works done through Udacity data engineering nano degree
  ☆74Updated last year
• afaqueahmad7117 / spark-experiments
  Ultimate guide for mastering Spark Performance Tuning and Optimization concepts and for preparing for Data Engineering interviews
  ☆113Updated 10 months ago
• andrem8 / surf_dash
  ☆151Updated 2 years ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆74Updated last month
• sidharth1805 / Spotify_etl
  ☆135Updated 2 years ago
• josephmachado / spark_submit_airflow
  Simple repo to demonstrate how to submit a spark job to EMR from Airflow
  ☆33Updated 4 years ago
• josephmachado / efficient_data_processing_spark
  Code for "Efficient Data Processing in Spark" Course
  ☆287Updated 5 months ago
• rohitrsp898 / Basic_ETL_PySpark
  ☆21Updated last year
• ris-tlp / audiophile-e2e-pipeline
  Pipeline that extracts data from Crinacle's Headphone and InEarMonitor databases and finalizes data for a Metabase Dashboard. The dashboa…
  ☆226Updated 2 years ago
• hyunjoonbok / PySpark
  PySpark functions and utilities with examples. Assists ETL process of data modeling
  ☆100Updated 4 years ago
• josephmachado / online_store
  End to end data engineering project
  ☆53Updated 2 years ago
• ismaildawoodjee / aws-data-pipeline
  A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…
  ☆21Updated 2 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆53Updated last year
• nareshk1290 / Udacity-Data-Engineering
  Udacity Data Engineering Nano Degree (DEND)
  ☆184Updated 5 years ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆99Updated 9 months ago