Alternatives and similar repositories for aws_end_to_end_streaming_pipeline:

Users that are interested in aws_end_to_end_streaming_pipeline are comparing it to the libraries listed below

• dogukannulu / glue_etl_job_data_catalog_s3
  Glue ETL job or EMR Spark that gets from data catalog, modifies and uploads to S3 and Data Catalog
  ☆11Updated last year
• dogukannulu / airflow_kafka_cassandra_mongodb
  Produce Kafka messages, consume them and upload into Cassandra, MongoDB.
  ☆41Updated last year
• JesusAcuna / data-engineering-project
  ☆28Updated last year
• josephmachado / python_essentials_for_data_engineers
  Code for blog at https://www.startdataengineering.com/post/python-for-de/
  ☆74Updated 10 months ago
• HamzaG737 / data-engineering-project
  End to end data engineering project with kafka, airflow, spark, postgres and docker.
  ☆91Updated last month
• dogukannulu / csv_extract_airflow_docker
  Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.
  ☆35Updated last year
• itversity / data-engineering-spark
  ☆87Updated 2 years ago
• airscholar / modern-data-eng-dbt-databricks-azure
  In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …
  ☆27Updated last year
• Eshwarreddyt / Data-Engineering-project-on-Formula1-Racing-using-Azure-Databricks
  Real World Project on Formula1 Racing using Azure Databricks, Delta Lake and Azure Data Factory
  ☆13Updated last year
• josephmachado / sde_de101_josephmachado
  Sample repo for startdataengineering DE 101 free course
  ☆59Updated 10 months ago
• Lal4Tech / Data-Engineering-With-AWS
  Resources and projects from Udacity Data Engineering with AWS nano degree programme
  ☆25Updated 2 years ago
• SatadruMukherjee / Data-Preprocessing-Models
  ☆64Updated last week
• darshilparmar / twitter-airflow-data-engineering-project
  YouTube tutorial project
  ☆101Updated last year
• TripathiAshutosh / mlflow
  MLflow related work
  ☆38Updated last year
• PacktPublishing / Data-Engineering-with-AWS-2nd-edition
  Data Engineering with AWS, 2nd edition - Published by Packt
  ☆138Updated last year
• sidharth1805 / Spotify_etl
  ☆138Updated 2 years ago
• mharty3 / energy_data_capstone
  ☆34Updated last year
• itversity / databricks-certification-spark
  Databricks Certified Associate Spark Developer preparation toolkit to setup single node Standalone Spark Cluster along with material in t…
  ☆30Updated last year
• josephmachado / adv_data_transformation_in_sql
  Code for "Advanced data transformations in SQL" free live workshop
  ☆78Updated 6 months ago
• airscholar / realtime-voting-data-engineering
  This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…
  ☆36Updated last year
• josephmachado / online_store
  End to end data engineering project
  ☆54Updated 2 years ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆40Updated 9 months ago
• hyunjoonbok / amazon-sagemaker
  End-to-End examples that show how to solve business problems using Amazon SageMaker and it's ML/DL algorithm.
  ☆17Updated last year
• josephmachado / socialetl
  Project for "Data pipeline design patterns" blog.
  ☆45Updated 8 months ago
• hyunjoonbok / PySpark
  PySpark functions and utilities with examples. Assists ETL process of data modeling
  ☆101Updated 4 years ago
• dogukannulu / streaming_data_processing
  Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO
  ☆60Updated last year
• itversity / data-engineering-on-gcp
  Data Engineering on GCP
  ☆35Updated 2 years ago
• aws-samples / data-engineering-on-aws
  ☆20Updated 6 months ago
• PacktPublishing / Data-Engineering-with-Google-Cloud-Platform
  Data Engineering with Google Cloud Platform, published by Packt
  ☆117Updated last year
• darshilparmar / dataengineering-youtube-analysis-project
  Data Engineering YouTube Analysis Project by Darshil Parmar
  ☆191Updated last year