Alternatives and similar repositories for Data-Engineering-Streaming-Project

Users that are interested in Data-Engineering-Streaming-Project are comparing it to the libraries listed below

• JesusAcuna / data-engineering-project
  ☆28Updated last year
• damklis / etljob
  Simple ETL pipeline using Python
  ☆26Updated 2 years ago
• supratim94336 / DataEngineeringCapstoneProject
  😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS
  ☆46Updated 5 years ago
• hyunjoonbok / PySpark
  PySpark functions and utilities with examples. Assists ETL process of data modeling
  ☆103Updated 4 years ago
• HamzaG737 / data-engineering-project
  End to end data engineering project with kafka, airflow, spark, postgres and docker.
  ☆95Updated 2 months ago
• airscholar / modern-data-eng-dbt-databricks-azure
  In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …
  ☆29Updated last year
• dogukannulu / airflow_kafka_cassandra_mongodb
  Produce Kafka messages, consume them and upload into Cassandra, MongoDB.
  ☆42Updated last year
• josephmachado / online_store
  End to end data engineering project
  ☆55Updated 2 years ago
• mharty3 / energy_data_capstone
  ☆34Updated last year
• josephmachado / adv_data_transformation_in_sql
  Code for "Advanced data transformations in SQL" free live workshop
  ☆81Updated 3 weeks ago
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆191Updated last year
• AnandDedha / aws-airflow-dataengineering-pipeline
  ☆21Updated last year
• subhamkharwal / ease-with-apache-spark
  Series follows learning from Apache Spark (PySpark) with quick tips and workaround for daily problems in hand
  ☆53Updated last year
• airscholar / realtime-voting-data-engineering
  This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…
  ☆38Updated last year
• itversity / data-engineering-spark
  ☆87Updated 2 years ago
• andrem8 / surf_dash
  ☆151Updated 3 years ago
• ArpiteshSrivastava / spotify-data-engineering-project
  In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…
  ☆22Updated 2 years ago
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆145Updated 4 years ago
• martandsingh / ApacheSpark
  This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…
  ☆98Updated 10 months ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆103Updated 11 months ago
• hnawaz007 / dbt-dw
  build dw with dbt
  ☆45Updated 7 months ago
• guoliveira / data-engineer-zoomcamp-project
  ☆38Updated 2 years ago
• josephmachado / de_project
  Step by step instructions to create a production-ready data pipeline
  ☆50Updated 5 months ago
• danieldiamond / data-engineering-capstone
  Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development
  ☆21Updated 5 years ago
• josephmachado / python_essentials_for_data_engineers
  Code for blog at https://www.startdataengineering.com/post/python-for-de/
  ☆76Updated 11 months ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆113Updated 2 months ago
• dogukannulu / csv_extract_airflow_docker
  Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.
  ☆35Updated last year
• darshilparmar / twitter-airflow-data-engineering-project
  YouTube tutorial project
  ☆103Updated last year
• ris-tlp / audiophile-e2e-pipeline
  Pipeline that extracts data from Crinacle's Headphone and InEarMonitor databases and finalizes data for a Metabase Dashboard. The dashboa…
  ☆231Updated 2 years ago
• SatadruMukherjee / Data-Preprocessing-Models
  ☆65Updated last week