Alternatives and similar repositories for traffic-flow-spark-kafka

Users that are interested in traffic-flow-spark-kafka are comparing it to the libraries listed below

• dbusteed / kafka-spark-streaming-example
  ☆36Updated 5 years ago
• Tirth27 / Real-time-analytics-with-spark-streaming
  This project aims to build a streaming application to perform real-time analytics of Covid-19 related tweets and deploy an ML model for r…
  ☆14Updated 4 years ago
• amanparmar17 / Kafka_Pyspark
  Base Kafka Producer, consumer, flask api and PySpark Structured streaming Job
  ☆11Updated 4 years ago
• yennanliu / NYC_Taxi_Pipeline
  Stream/batch system with Hadoop, Spark on NYC taxi data | #DE
  ☆26Updated 2 months ago
• yesdinesh / Object-Detection-using-Spark-Docker-Kafka-Video-Streaming
  ☆12Updated 4 years ago
• zhujun98 / data-engineering
  Spark, Airflow, Kafka
  ☆25Updated 2 years ago
• rodrigo-arenas / kafkaml-anomaly-detection
  Project for real-time anomaly detection using Kafka and python
  ☆58Updated 2 years ago
• jaumpedro214 / posts
  A list of all my posts and personal projects
  ☆73Updated last month
• jackgisby / tfl-bikes-data-pipeline
  Processing TfL data for bike usage with Google Cloud Platform.
  ☆46Updated 3 years ago
• QuentinAmbard / databricks-demo
  Simple demo for Databricks!
  ☆14Updated 2 years ago
• josephmachado / socialetl
  Project for "Data pipeline design patterns" blog.
  ☆47Updated last year
• shravan-kuchkula / udacity-data-eng-proj2
  A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract d…
  ☆24Updated 4 years ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆110Updated last year
• jacob1421 / RustCheatersDataPipeline
  Data pipeline that scrapes Rust cheater Steam profiles
  ☆54Updated 3 years ago
• itversity / data-engineering-spark
  ☆88Updated 3 years ago
• dogukannulu / airflow_kafka_cassandra_mongodb
  Produce Kafka messages, consume them and upload into Cassandra, MongoDB.
  ☆42Updated 2 years ago
• moontucer / Data-Streaming-Project
  used Airflow, Postgres, Kafka, Spark, and Cassandra, and GitHub Actions to establish an end-to-end data pipeline
  ☆29Updated 2 years ago
• danieldiamond / data-engineering-capstone
  Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development
  ☆21Updated 6 years ago
• danielbeach / unitTestPySpark
  how to unit test your PySpark code
  ☆29Updated 4 years ago
• josephmachado / e2e_datapipeline_test
  Example repo to create end to end tests for data pipeline.
  ☆25Updated last year
• PacktPublishing / Mastering-Big-Data-Analytics-with-PySpark
  Mastering Big Data Analytics with PySpark, Published by Packt
  ☆163Updated last year
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆57Updated 4 years ago
• josephmachado / analytical_dp_with_sql
  Code for my "Efficient Data Processing in SQL" book.
  ☆60Updated last year
• vb100 / deploy-ml-mlflow-aws
  Deploying Models to Production with Mlflow and AWS Sagemaker
  ☆23Updated 4 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆55Updated 2 years ago
• ismaildawoodjee / aws-data-pipeline
  A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…
  ☆23Updated 3 years ago
• Philippos01 / mlops-energy-forecast-thesis
  Automated pipeline for energy consumption forecasting across Europe using Azure cloud and Databricks.
  ☆12Updated 2 years ago
• SatadruMukherjee / Data-Preprocessing-Models
  ☆70Updated 3 weeks ago
• team-data-science / aws-data-engineering
  Course Material Data Engineering on AWS Course
  ☆30Updated last year
• im-nsk / Building-an-Automated-Weather-Data-Pipeline-with-Airflow-From-Ingestion-to-Data-Warehouse
  This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeath…
  ☆22Updated 2 years ago