Alternatives and similar repositories for traffic-flow-spark-kafka:

Users that are interested in traffic-flow-spark-kafka are comparing it to the libraries listed below

• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆99Updated 9 months ago
• hnawaz007 / dbt-dw
  build dw with dbt
  ☆43Updated 5 months ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆40Updated 8 months ago
• josephmachado / online_store
  End to end data engineering project
  ☆53Updated 2 years ago
• yennanliu / NYC_Taxi_Pipeline
  Design/Implement stream/batch architecture on NYC taxi data | #DE
  ☆25Updated 3 years ago
• josephmachado / socialetl
  Project for "Data pipeline design patterns" blog.
  ☆45Updated 7 months ago
• danieldiamond / data-engineering-capstone
  Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development
  ☆21Updated 5 years ago
• dogukannulu / streaming_data_processing
  Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO
  ☆59Updated last year
• yesdinesh / Object-Detection-using-Spark-Docker-Kafka-Video-Streaming
  ☆12Updated 3 years ago
• airscholar / SparkingFlow
  This project demonstrates how to use Apache Airflow to submit jobs to Apache spark cluster in different programming laguages using Python…
  ☆41Updated last year
• dogukannulu / airflow_kafka_cassandra_mongodb
  Produce Kafka messages, consume them and upload into Cassandra, MongoDB.
  ☆40Updated last year
• dbusteed / kafka-spark-streaming-example
  ☆37Updated 5 years ago
• damklis / etljob
  Simple ETL pipeline using Python
  ☆25Updated last year
• im-nsk / Building-an-Automated-Weather-Data-Pipeline-with-Airflow-From-Ingestion-to-Data-Warehouse
  This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeath…
  ☆21Updated last year
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆46Updated 2 years ago
• sdw-online / postgres-dwh
  A Postgres data warehouse for processing synthetic data using IAC principles
  ☆16Updated 2 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆53Updated last year
• jaumpedro214 / posts
  A list of all my posts and personal projects
  ☆70Updated 9 months ago
• rohitrsp898 / Basic_ETL_PySpark
  ☆21Updated 2 years ago
• shravan-kuchkula / udacity-data-eng-proj2
  A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract d…
  ☆24Updated 3 years ago
• josephmachado / e2e_datapipeline_test
  Example repo to create end to end tests for data pipeline.
  ☆22Updated 9 months ago
• rodrigo-arenas / kafkaml-anomaly-detection
  Project for real-time anomaly detection using Kafka and python
  ☆58Updated 2 years ago
• guoliveira / data-engineer-zoomcamp-project
  ☆38Updated last year
• Tirth27 / Real-time-analytics-with-spark-streaming
  This project aims to build a streaming application to perform real-time analytics of Covid-19 related tweets and deploy an ML model for r…
  ☆13Updated 3 years ago
• pran4ajith / spark-twitter-streaming
  A real-time streaming ETL pipeline for streaming and performing sentiment analysis on Twitter data using Apache Kafka, Apache Spark and D…
  ☆30Updated 4 years ago
• TJaniF / airflow-elt-blueprint
  A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
  ☆66Updated last year
• better-data-science / Apache-Kafka-in-Python
  Source code for the Apache Kafka in Python video series
  ☆19Updated 3 years ago
• SatadruMukherjee / Data-Preprocessing-Models
  ☆64Updated last week
• ismaildawoodjee / aws-data-pipeline
  A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…
  ☆21Updated 2 years ago
• aravindr18 / RedditR--Insight-Data-Engineering-Project
  RedditR for Content Engagement and Recommendation
  ☆21Updated 7 years ago