Alternatives and similar repositories for aws-data-pipeline

Users that are interested in aws-data-pipeline are comparing it to the libraries listed below

• supratim94336 / DataEngineeringCapstoneProject
  😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS
  ☆50Updated 6 years ago
• itversity / data-engineering-spark
  ☆88Updated 3 years ago
• hyunjoonbok / PySpark
  PySpark functions and utilities with examples. Assists ETL process of data modeling
  ☆104Updated 5 years ago
• JesusAcuna / data-engineering-project
  ☆29Updated 2 years ago
• martandsingh / ApacheSpark
  This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…
  ☆103Updated 2 months ago
• mharty3 / energy_data_capstone
  ☆36Updated 2 years ago
• damklis / etljob
  Simple ETL pipeline using Python
  ☆29Updated 2 years ago
• josephmachado / online_store
  End to end data engineering project
  ☆57Updated 3 years ago
• SatadruMukherjee / Data-Preprocessing-Models
  ☆70Updated 3 weeks ago
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆201Updated last year
• guoliveira / data-engineer-zoomcamp-project
  ☆42Updated 2 years ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆44Updated last year
• dogukannulu / kafka_spark_structured_streaming
  Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra
  ☆143Updated 2 years ago
• HamzaG737 / data-engineering-project
  End to end data engineering project with kafka, airflow, spark, postgres and docker.
  ☆107Updated 8 months ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆55Updated 2 years ago
• ajupton / big-data-engineering-project
  Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR
  ☆88Updated 6 years ago
• afaqueahmad7117 / spark-experiments
  Ultimate guide for mastering Spark Performance Tuning and Optimization concepts and for preparing for Data Engineering interviews
  ☆177Updated 2 months ago
• uhussain / WebCrawlerForInflation
  Price Crawler - Tracking Price Inflation
  ☆187Updated 5 years ago
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆158Updated 5 years ago
• Wittline / uber-expenses-tracking
  The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such …
  ☆122Updated 3 years ago
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆165Updated 2 months ago
• coder2j / pyspark-tutorial
  PySpark Tutorial for Beginners - Practical Examples in Jupyter Notebook with Spark version 3.4.1. The tutorial covers various topics like…
  ☆138Updated 2 years ago
• raveendratal / ravi_azureadbadf
  Ravi Azure ADB ADF Repository
  ☆64Updated 10 months ago
• josephmachado / e2e_datapipeline_test
  Example repo to create end to end tests for data pipeline.
  ☆25Updated last year
• EcZachly / video-game-training-sql
  Hey this is the repo that has all the queries and data for my video game training series!
  ☆153Updated 3 years ago
• sankamuk / PysparkCheatsheet
  PySpark Cheatsheet
  ☆36Updated 2 years ago
• darshilparmar / twitter-airflow-data-engineering-project
  YouTube tutorial project
  ☆105Updated 2 years ago
• PacktPublishing / Data-Engineering-with-AWS
  Data Engineering with AWS, Published by Packt
  ☆334Updated 2 years ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆110Updated last year
• danielbeach / dataEngineeringTemplate
  Template for Data Engineering and Data Pipeline projects
  ☆115Updated 2 years ago