Alternatives and similar repositories for AWS-Glue-Pyspark-ETL-Job

Users that are interested in AWS-Glue-Pyspark-ETL-Job are comparing it to the libraries listed below

• JoseRFJuniorLLMs / PySpark-ETL
  PySpark-ETL
  ☆22Updated 6 years ago
• itversity / spark-sql
  Apache Spark using SQL
  ☆14Updated 4 years ago
• Rajsingh92 / MUST_HAVE_SKILLS
  This repo consists of all important concepts for data engineers.
  ☆11Updated last year
• hyunjoonbok / PySpark
  PySpark functions and utilities with examples. Assists ETL process of data modeling
  ☆104Updated 5 years ago
• PacktPublishing / Snowflake-Cookbook
  Snowflake Cookbook, published by Packt
  ☆82Updated 3 years ago
• damklis / etljob
  Simple ETL pipeline using Python
  ☆29Updated 2 years ago
• aws-samples / data-engineering-for-aws-immersion-day
  Lab Instructions for Data Engineering Immersion Day
  ☆196Updated this week
• ShafiqaIqbal / AWS-Glue-Pyspark-ETL-Job
  A Pyspark job to handle upserts, conversion to parquet and create partitions on S3
  ☆28Updated 5 years ago
• itversity / data-engineering-spark
  ☆88Updated 3 years ago
• shravan-kuchkula / udacity-data-eng-proj4
  Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as …
  ☆16Updated 6 years ago
• vivek-bombatkar / Spark-with-Python---My-learning-notes-
  ETL pipeline using pyspark (Spark - Python)
  ☆116Updated 5 years ago
• shravan-kuchkula / udacity-data-eng-proj-1
  Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…
  ☆89Updated 4 years ago
• RealKinetic / aws-glue-pipeline-example
  An example CI/CD pipeline using GitHub Actions for doing continuous deployment of AWS Glue jobs built on PySpark and Jupyter Notebooks.
  ☆13Updated 5 years ago
• jleetutorial / python-spark-streaming
  ☆152Updated 7 years ago
• raveendratal / ravi_azureadbadf
  Ravi Azure ADB ADF Repository
  ☆64Updated last year
• aws-dojo / analytics
  code snippet for analytics sessions
  ☆34Updated 3 years ago
• arverma / TowardsDataEngineering
  This repo contains commands that data engineers use in day to day work.
  ☆61Updated 2 years ago
• dimajix / spark-training
  Repository used for Spark Trainings
  ☆54Updated 2 years ago
• LearningJournal / Spark-Streaming-In-Python
  Apache Spark 3 - Structured Streaming Course Material
  ☆126Updated 2 years ago
• sankamuk / PysparkCheatsheet
  PySpark Cheatsheet
  ☆36Updated 3 years ago
• garystafford / tickit-data-lake-demo
  Resources for video demonstrations and blog posts related to DataOps on AWS
  ☆182Updated 4 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆56Updated 2 years ago
• supratim94336 / DataEngineeringCapstoneProject
  😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS
  ☆50Updated 6 years ago
• shravan-kuchkula / udacity-data-eng-proj2
  A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract d…
  ☆24Updated 4 years ago
• sushantkhara / Microsoft-DP-203-Azure-Data-Engineer-Associate-Preparation
  ☆27Updated 3 years ago
• tharsha18 / gluelabs
  ☆14Updated 4 years ago
• BenSchr / Udacity-Data-Engineering-Projects
  My solutions for the Udacity Data Engineering Nanodegree
  ☆34Updated 6 years ago
• ddgope / Data-Pipelines-with-Airflow
  This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…
  ☆96Updated 6 years ago
• ajupton / big-data-engineering-project
  Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR
  ☆88Updated 6 years ago
• Snowflake-Labs / sfguide-data-engineering-with-snowpark-python
  ☆142Updated 11 months ago