Alternatives and similar repositories for pyspark-on-aws-emr:

Users that are interested in pyspark-on-aws-emr are comparing it to the libraries listed below

• itversity / data-engineering-spark
  ☆87Updated 2 years ago
• sankamuk / PysparkCheatsheet
  PySpark Cheatsheet
  ☆36Updated 2 years ago
• abhishek-ch / data-machinelearning-the-boring-way
  Build & Learn Data Engineering,Machine Learning over Kubernetes. No Shortcut approach.
  ☆57Updated 2 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆54Updated 2 years ago
• Wittline / data-engineer-challenge
  Challenge Data Engineer
  ☆25Updated 2 years ago
• manuel-lang / Data-Engineering-Nanodegree
  Solution to all projects of Udacity's Data Engineering Nanodegree: Data Modeling with Postgres & Cassandra, Data Warehouse with Redshift,…
  ☆56Updated 2 years ago
• airscholar / modern-data-eng-dbt-databricks-azure
  In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …
  ☆27Updated last year
• immu0001 / Udacity-Data-Engineer-nanodegree
  Classwork projects and home works done through Udacity data engineering nano degree
  ☆74Updated last year
• im-nsk / Building-an-Automated-Weather-Data-Pipeline-with-Airflow-From-Ingestion-to-Data-Warehouse
  This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeath…
  ☆21Updated last year
• damklis / etljob
  Simple ETL pipeline using Python
  ☆26Updated last year
• jacob1421 / RustCheatersDataPipeline
  Data pipeline that scrapes Rust cheater Steam profiles
  ☆52Updated 3 years ago
• BenSchr / Udacity-Data-Engineering-Projects
  My solutions for the Udacity Data Engineering Nanodegree
  ☆34Updated 5 years ago
• vivek-bombatkar / Spark-with-Python---My-learning-notes-
  ETL pipeline using pyspark (Spark - Python)
  ☆114Updated 5 years ago
• shravan-kuchkula / udacity-data-eng-proj4
  Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as …
  ☆16Updated 5 years ago
• ktnsh24 / DataModelling
  This repo will guide you step-by-step method to create star schema dimensional model.
  ☆25Updated 3 years ago
• zacharyt-cs / reddit-data-engineering
  An end-to-end data engineering pipeline to create a dashboard for the latest content on the r/Stocks subreddit
  ☆19Updated 2 years ago
• Jayvardhan-Reddy / Azure-Certification-DP-201
  Road to Azure Data Engineer Part-II: DP-201 - Designing an Azure Data Solution
  ☆19Updated 4 years ago
• Stefen-Taime / modern-data-pipeline
  reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.
  ☆14Updated last year
• josephmachado / online_store
  End to end data engineering project
  ☆54Updated 2 years ago
• mrn-aglic / apache-iceberg-data-exploration
  ☆18Updated last year
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆144Updated 4 years ago
• sparsh-ai / recohut
  Recohut - Learn data engineering, data science
  ☆97Updated last year
• martandsingh / ApacheSpark
  This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…
  ☆98Updated 9 months ago
• shravan-kuchkula / dataEngineering
  A repo to track data engineering projects
  ☆13Updated 2 years ago
• mohanakrishnavh / PySpark-Tutorial
  ☆18Updated 7 years ago
• supratim94336 / DataEngineeringCapstoneProject
  😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS
  ☆45Updated 5 years ago
• pran4ajith / spark-twitter-streaming
  A real-time streaming ETL pipeline for streaming and performing sentiment analysis on Twitter data using Apache Kafka, Apache Spark and D…
  ☆30Updated 4 years ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆102Updated 10 months ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆40Updated 10 months ago
• aravindr18 / RedditR--Insight-Data-Engineering-Project
  RedditR for Content Engagement and Recommendation
  ☆22Updated 7 years ago