Alternatives and similar repositories for traffic-flow-spark-kafka:

Users that are interested in traffic-flow-spark-kafka are comparing it to the libraries listed below

• dbusteed / kafka-spark-streaming-example
  ☆37Updated 5 years ago
• airscholar / modern-data-eng-dbt-databricks-azure
  In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …
  ☆24Updated last year
• josephmachado / socialetl
  Project for "Data pipeline design patterns" blog.
  ☆43Updated 5 months ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆40Updated 6 months ago
• dogukannulu / airflow_kafka_cassandra_mongodb
  Produce Kafka messages, consume them and upload into Cassandra, MongoDB.
  ☆39Updated last year
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆45Updated 2 years ago
• indiacloudtv / pyspark_on_google_colab
  PySpark Tutorial for Beginners on Google Colab: Hands-On Guide
  ☆16Updated 4 years ago
• jackgisby / tfl-bikes-data-pipeline
  Processing TfL data for bike usage with Google Cloud Platform.
  ☆42Updated 2 years ago
• rafaelvp-db / databricks-end-to-end-streaming
  End-to-end Kafka Streaming Examples on Databricks with Evolving Avro Schemas.
  ☆9Updated 10 months ago
• hnawaz007 / dbt-dw
  build dw with dbt
  ☆33Updated 2 months ago
• anilkulkarni87 / airflow-docker
  This is my Apache Airflow Local development setup on Windows 10 WSL2/Mac using docker-compose. It will also include some sample DAGs and …
  ☆27Updated 11 months ago
• shravan-kuchkula / udacity-data-eng-proj4
  Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as …
  ☆16Updated 5 years ago
• dogukannulu / streaming_data_processing
  Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO
  ☆57Updated last year
• better-data-science / Apache-Kafka-in-Python
  Source code for the Apache Kafka in Python video series
  ☆19Updated 2 years ago
• yennanliu / NYC_Taxi_Pipeline
  Design/Implement stream/batch architecture on NYC taxi data | #DE
  ☆26Updated 3 years ago
• renardeinside / e2e-mlops-demo
  E2E MLOps with Databricks
  ☆14Updated last month
• team-data-science / aws-data-engineering
  Course Material Data Engineering on AWS Course
  ☆28Updated 4 months ago
• danieldiamond / data-engineering-capstone
  Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development
  ☆21Updated 5 years ago
• Kavit900 / data-streaming-kafka-flink-postgres
  ☆29Updated last year
• itversity / data-engineering-spark
  ☆86Updated 2 years ago
• airscholar / realtime-voting-data-engineering
  This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…
  ☆34Updated last year
• akashmehta10 / cdc_pyspark_hive
  ☆22Updated 2 years ago
• pran4ajith / spark-twitter-streaming
  A real-time streaming ETL pipeline for streaming and performing sentiment analysis on Twitter data using Apache Kafka, Apache Spark and D…
  ☆29Updated 4 years ago
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆47Updated 3 years ago
• guidok91 / spark-movies-etl
  Spark data pipeline that processes movie ratings data.
  ☆27Updated this week
• ysfesr / Building-Data-LakeHouse
  Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data
  ☆41Updated last year
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆94Updated 7 months ago
• danielbeach / unitTestPySpark
  how to unit test your PySpark code
  ☆28Updated 3 years ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆49Updated last week