Alternatives and similar repositories for data-engineering-on-gcp

Users that are interested in data-engineering-on-gcp are comparing it to the libraries listed below

• hyunjoonbok / PySpark
  PySpark functions and utilities with examples. Assists ETL process of data modeling
  ☆104Updated 5 years ago
• itversity / data-engineering-spark
  ☆88Updated 3 years ago
• supratim94336 / DataEngineeringCapstoneProject
  😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS
  ☆50Updated 6 years ago
• PacktPublishing / Data-Engineering-with-Google-Cloud-Platform
  Data Engineering with Google Cloud Platform, published by Packt
  ☆120Updated 2 years ago
• martandsingh / ApacheSpark
  This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…
  ☆105Updated 4 months ago
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆162Updated 5 years ago
• LearningJournal / Spark-Streaming-In-Python
  Apache Spark 3 - Structured Streaming Course Material
  ☆126Updated 2 years ago
• immu0001 / Udacity-Data-Engineer-nanodegree
  Classwork projects and home works done through Udacity data engineering nano degree
  ☆75Updated 2 years ago
• abhilash-1 / pyspark-project
  This is the first project where we worked on apache spark, In this project what we have done is that we downloaded the datasets from KAGG…
  ☆22Updated 4 years ago
• darshilparmar / twitter-airflow-data-engineering-project
  YouTube tutorial project
  ☆108Updated 2 years ago
• raveendratal / ravi_azureadbadf
  Ravi Azure ADB ADF Repository
  ☆64Updated last year
• manuel-lang / Data-Engineering-Nanodegree
  Solution to all projects of Udacity's Data Engineering Nanodegree: Data Modeling with Postgres & Cassandra, Data Warehouse with Redshift,…
  ☆57Updated 3 years ago
• raveendratal / PysparkRaveendra
  Git Repository
  ☆152Updated last month
• SatadruMukherjee / Data-Preprocessing-Models
  ☆70Updated this week
• coder2j / pyspark-tutorial
  PySpark Tutorial for Beginners - Practical Examples in Jupyter Notebook with Spark version 3.4.1. The tutorial covers various topics like…
  ☆141Updated 2 years ago
• team-data-science / aws-data-engineering
  Course Material Data Engineering on AWS Course
  ☆31Updated last year
• kaburelabs / Data-Engineering-track-with-Python
  All Data Engineering notebooks from Datacamp course
  ☆116Updated 6 years ago
• dogukannulu / airflow_kafka_cassandra_mongodb
  Produce Kafka messages, consume them and upload into Cassandra, MongoDB.
  ☆43Updated 2 years ago
• ddgope / Data-Pipelines-with-Airflow
  This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…
  ☆97Updated 6 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆56Updated 2 years ago
• ajupton / big-data-engineering-project
  Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR
  ☆88Updated 6 years ago
• damklis / etljob
  Simple ETL pipeline using Python
  ☆29Updated 2 years ago
• Snowflake-Labs / sfguide-data-engineering-with-snowpark-python
  ☆142Updated 11 months ago
• johnny-chivers / aws-data-engineering
  Resources for the free AWS Data Engineering course on youtube
  ☆104Updated 4 years ago
• AISCIENCES / course-master-big-data-with-pyspark-and-aws
  Master Big Data With PySpark and AWS
  ☆132Updated 2 years ago
• dgadiraju / retail_db
  ☆54Updated 5 years ago
• vivek-bombatkar / Spark-with-Python---My-learning-notes-
  ETL pipeline using pyspark (Spark - Python)
  ☆116Updated 5 years ago
• dgadiraju / itversity-books
  ☆118Updated 5 years ago
• JesusAcuna / data-engineering-project
  ☆30Updated 2 years ago
• subhamkharwal / ease-with-apache-spark
  Series follows learning from Apache Spark (PySpark) with quick tips and workaround for daily problems in hand
  ☆56Updated 2 years ago