Alternatives and similar repositories for traffic-flow-spark-kafka

Users that are interested in traffic-flow-spark-kafka are comparing it to the libraries listed below

• danieldiamond / data-engineering-capstone
  Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development
  ☆21Updated 5 years ago
• aravindr18 / RedditR--Insight-Data-Engineering-Project
  RedditR for Content Engagement and Recommendation
  ☆21Updated 7 years ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆40Updated 11 months ago
• damklis / etljob
  Simple ETL pipeline using Python
  ☆26Updated 2 years ago
• TJaniF / airflow-elt-blueprint
  A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
  ☆69Updated last year
• yennanliu / NYC_Taxi_Pipeline
  Design/Implement stream/batch architecture on NYC taxi data | #DE
  ☆25Updated 4 years ago
• jaumpedro214 / posts
  A list of all my posts and personal projects
  ☆73Updated 11 months ago
• guoliveira / data-engineer-zoomcamp-project
  ☆40Updated 2 years ago
• josephmachado / e2e_datapipeline_test
  Example repo to create end to end tests for data pipeline.
  ☆24Updated 11 months ago
• dbusteed / kafka-spark-streaming-example
  ☆37Updated 5 years ago
• itversity / data-engineering-spark
  ☆87Updated 2 years ago
• im-nsk / Building-an-Automated-Weather-Data-Pipeline-with-Airflow-From-Ingestion-to-Data-Warehouse
  This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeath…
  ☆21Updated 2 years ago
• itversity / spark-sql
  Apache Spark using SQL
  ☆14Updated 3 years ago
• ongxuanhong / de03-trino-dbt-spark-everything-everywhere-all-at-once
  ☆16Updated last year
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆103Updated 11 months ago
• yTek01 / docker-spark-airflow
  ☆38Updated 2 years ago
• shravan-kuchkula / udacity-data-eng-proj4
  Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as …
  ☆16Updated 5 years ago
• dogukannulu / airflow_kafka_cassandra_mongodb
  Produce Kafka messages, consume them and upload into Cassandra, MongoDB.
  ☆42Updated last year
• josephmachado / online_store
  End to end data engineering project
  ☆56Updated 2 years ago
• airscholar / realtime-voting-data-engineering
  This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…
  ☆39Updated last year
• jacob1421 / RustCheatersDataPipeline
  Data pipeline that scrapes Rust cheater Steam profiles
  ☆51Updated 3 years ago
• josephmachado / data-engineering-interview-series
  Repository for Data Engineering Interview Series
  ☆31Updated 7 months ago
• ismaildawoodjee / aws-data-pipeline
  A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…
  ☆22Updated 3 years ago
• airscholar / modern-data-eng-dbt-databricks-azure
  In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …
  ☆31Updated last year
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆55Updated 2 years ago
• shabie / streaming_nd
  Data Streaming Nanodegree (from Udacity) exercises, projects and their solutions
  ☆17Updated last year
• dogukannulu / streaming_data_processing
  Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO
  ☆60Updated last year
• pran4ajith / spark-twitter-streaming
  A real-time streaming ETL pipeline for streaming and performing sentiment analysis on Twitter data using Apache Kafka, Apache Spark and D…
  ☆30Updated 4 years ago
• ankurchavda / data-engineering-zoomcamp
  A course by DataTalks Club that covers Spark, Kafka, Docker, Airflow, Terraform, DBT, Big Query etc
  ☆13Updated 3 years ago
• moj-analytical-services / etl-pipeline-example
  An example of an ETL pipeline that lays out generic DE processes. This is now out of date but still provides useful information
  ☆26Updated 3 years ago