Alternatives and similar repositories for Real-time-analytics-with-spark-streaming

Users that are interested in Real-time-analytics-with-spark-streaming are comparing it to the libraries listed below

• yesdinesh / Object-Detection-using-Spark-Docker-Kafka-Video-Streaming
  ☆12Updated 4 years ago
• trannhatnguyen2 / NYC_Taxi_Data_Pipeline
  Nyc_Taxi_Data_Pipeline - DE Project
  ☆120Updated 10 months ago
• jaumpedro214 / traffic-flow-spark-kafka
  Testing Spark Structured Streaming anf Kafka with real data from traffic sensors
  ☆16Updated 2 years ago
• airscholar / e2e-data-engineering
  An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Ka…
  ☆273Updated 6 months ago
• airscholar / RealtimeStreamingEngineering
  This project serves as a comprehensive guide to building an end-to-end data engineering pipeline using TCP/IP Socket, Apache Spark, OpenA…
  ☆39Updated last year
• dogukannulu / streaming_data_processing
  Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO
  ☆63Updated 2 years ago
• MarcusChong123 / Text-Clustering-with-Python
  I am going to show you step by step how to perform text clustering with Python. For full article, feel free to visit https://learndatasci…
  ☆10Updated 4 years ago
• jomariya23156 / sales-forecast-mlops-at-scale
  Full-stack Highly Scalable Cloud-native Machine Learning system for demand forecasting with realtime data streaming, inference, retrainin…
  ☆69Updated last year
• vb100 / deploy-ml-mlflow-aws
  Deploying Models to Production with Mlflow and AWS Sagemaker
  ☆23Updated 3 years ago
• airscholar / YoutubeAnalytics
  An end-to-end data engineering pipeline that fetches real-time YouTube analytics and streams them through Kafka for processing with ksqlD…
  ☆12Updated last year
• dbusteed / kafka-spark-streaming-example
  ☆37Updated 5 years ago
• airscholar / realtime-voting-data-engineering
  This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…
  ☆42Updated last year
• dogukannulu / airflow_kafka_cassandra_mongodb
  Produce Kafka messages, consume them and upload into Cassandra, MongoDB.
  ☆42Updated last year
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆44Updated last year
• dogukannulu / csv_extract_airflow_docker
  Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.
  ☆37Updated 2 years ago
• luongphambao / nyc-taxi-feature-store
  ☆54Updated last year
• Drissdo185 / Text-Summarization
  ☆28Updated last year
• darshilparmar / stock-market-kafka-data-engineering-project
  ☆203Updated 2 years ago
• Srijha09 / Prediction-of-Energy-Consumption
  Prediction of Energy Consumption using Machine Learning for Energy Sustainability
  ☆19Updated 6 years ago
• HamzaG737 / data-engineering-project
  End to end data engineering project with kafka, airflow, spark, postgres and docker.
  ☆102Updated 5 months ago
• YuchenXia / AASbyLLM
  Generate AAS models from PDF raw text with LLM. (still under construction)
  ☆14Updated last month
• SourabhSinghRana / real-time_crypto_data_pipeline_using_kafka
  I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that uti…
  ☆29Updated 2 years ago
• dogukannulu / kafka_spark_structured_streaming
  Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra
  ☆142Updated 2 years ago
• zhujun98 / data-engineering
  Spark, Airflow, Kafka
  ☆26Updated 2 years ago
• subhamkharwal / ease-with-apache-spark
  Series follows learning from Apache Spark (PySpark) with quick tips and workaround for daily problems in hand
  ☆55Updated last year
• airscholar / RedditDataEngineering
  This project provides a comprehensive data pipeline solution to extract, transform, and load (ETL) Reddit data into a Redshift data wareh…
  ☆153Updated last year
• darshilparmar / twitter-airflow-data-engineering-project
  YouTube tutorial project
  ☆105Updated last year
• ngtranminhtuan / LLMOPS
  NLP/LLM Mlops Pipeline to dev/train/evaluation, scalable deploy and monitoring systems.
  ☆22Updated last year
• sidharth1805 / Spotify_etl
  ☆142Updated 2 years ago
• ArkanNibrastama / ecommerce_data_pipeline
  This project contain build end-to-end e-commerce data from data source into data warehouse and visualization.
  ☆13Updated 11 months ago