Alternatives and similar repositories for pyspark-on-aws-emr

Users that are interested in pyspark-on-aws-emr are comparing it to the libraries listed below

• sankamuk / PysparkCheatsheet
  PySpark Cheatsheet
  ☆36Updated 2 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆55Updated 2 years ago
• martandsingh / ApacheSpark
  This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…
  ☆99Updated 10 months ago
• shravan-kuchkula / udacity-data-eng-proj4
  Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as …
  ☆16Updated 5 years ago
• Wittline / data-engineer-challenge
  Challenge Data Engineer
  ☆25Updated 3 years ago
• ktnsh24 / DataModelling
  This repo will guide you step-by-step method to create star schema dimensional model.
  ☆25Updated 4 years ago
• itversity / data-engineering-spark
  ☆87Updated 2 years ago
• Wittline / apache-spark-docker
  Dockerizing an Apache Spark Standalone Cluster
  ☆43Updated 2 years ago
• shravan-kuchkula / dataEngineering
  A repo to track data engineering projects
  ☆13Updated 2 years ago
• supratim94336 / DataEngineeringCapstoneProject
  😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS
  ☆48Updated 5 years ago
• hyunjoonbok / PySpark
  PySpark functions and utilities with examples. Assists ETL process of data modeling
  ☆103Updated 4 years ago
• damklis / etljob
  Simple ETL pipeline using Python
  ☆26Updated 2 years ago
• itversity / databricks-certification-spark
  Databricks Certified Associate Spark Developer preparation toolkit to setup single node Standalone Spark Cluster along with material in t…
  ☆31Updated last year
• jamesbyars / apache-spark-etl-pipeline-example
  Demonstration of using Apache Spark to build robust ETL pipelines while taking advantage of open source, general purpose cluster computin…
  ☆24Updated last year
• karenbajador / pyspark_greatexpectations
  ☆12Updated 3 years ago
• vivek-bombatkar / Spark-with-Python---My-learning-notes-
  ETL pipeline using pyspark (Spark - Python)
  ☆117Updated 5 years ago
• immu0001 / Udacity-Data-Engineer-nanodegree
  Classwork projects and home works done through Udacity data engineering nano degree
  ☆74Updated last year
• guoliveira / data-engineer-zoomcamp-project
  ☆39Updated 2 years ago
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆53Updated 4 years ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆102Updated last year
• danieldiamond / data-engineering-capstone
  Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development
  ☆21Updated 5 years ago
• mohanakrishnavh / PySpark-Tutorial
  ☆18Updated 7 years ago
• CICIFLY / Data_Engineering_Project_Portfolio
  Data Engineering, Data Warehouse, Data Mart, Cloud Data, AWS, SAS, Redshift, S3
  ☆30Updated 4 years ago
• sparsh-ai / recohut
  Recohut - Learn data engineering, data science
  ☆97Updated last year
• yennanliu / DE-100-days
  data engineering 100 days 🤖 🧲 🦾 | #DE
  ☆39Updated last year
• yennanliu / NYC_Taxi_Pipeline
  Design/Implement stream/batch architecture on NYC taxi data | #DE
  ☆25Updated 4 years ago
• datakickstart / databricks-notebooks
  ☆10Updated 3 years ago
• omidvd79 / Big_Data_Demystified
  Big Data Demystified meetup and blog examples
  ☆31Updated 10 months ago
• arverma / TowardsDataEngineering
  This repo contains commands that data engineers use in day to day work.
  ☆61Updated 2 years ago
• airscholar / modern-data-eng-dbt-databricks-azure
  In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …
  ☆32Updated last year