Alternatives and similar repositories for kafka-spark-streaming-example

Users that are interested in kafka-spark-streaming-example are comparing it to the libraries listed below

• yennanliu / NYC_Taxi_Pipeline
  Design/Implement stream/batch architecture on NYC taxi data | #DE
  ☆25Updated 4 years ago
• dbusteed / spark-structured-streaming
  ☆33Updated 5 years ago
• LearningJournal / Spark-Streaming-In-Python
  Apache Spark 3 - Structured Streaming Course Material
  ☆121Updated last year
• indiacloudtv / structuredstreamingkafkapyspark
  Apche Spark Structured Streaming with Kafka using Python(PySpark)
  ☆40Updated 6 years ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆40Updated 11 months ago
• pran4ajith / spark-twitter-streaming
  A real-time streaming ETL pipeline for streaming and performing sentiment analysis on Twitter data using Apache Kafka, Apache Spark and D…
  ☆30Updated 4 years ago
• rafaelvp-db / databricks-end-to-end-streaming
  End-to-end Kafka Streaming Examples on Databricks with Evolving Avro Schemas.
  ☆9Updated last year
• aravindr18 / RedditR--Insight-Data-Engineering-Project
  RedditR for Content Engagement and Recommendation
  ☆21Updated 7 years ago
• JoseRFJuniorLLMs / PySpark-ETL
  PySpark-ETL
  ☆23Updated 5 years ago
• dogukannulu / kafka_spark_structured_streaming
  Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra
  ☆139Updated last year
• NeerajBhadani / spark-streaming
  This repository contains code for Spark Streaming
  ☆22Updated 4 years ago
• immu0001 / Udacity-Data-Engineer-nanodegree
  Classwork projects and home works done through Udacity data engineering nano degree
  ☆74Updated last year
• sankamuk / PysparkCheatsheet
  PySpark Cheatsheet
  ☆36Updated 2 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆55Updated 2 years ago
• jaumpedro214 / traffic-flow-spark-kafka
  Testing Spark Structured Streaming anf Kafka with real data from traffic sensors
  ☆16Updated 2 years ago
• rodrigo-arenas / kafkaml-anomaly-detection
  Project for real-time anomaly detection using Kafka and python
  ☆58Updated 2 years ago
• itversity / data-engineering-spark
  ☆87Updated 2 years ago
• indiacloudtv / pyspark_on_google_colab
  PySpark Tutorial for Beginners on Google Colab: Hands-On Guide
  ☆16Updated 4 years ago
• vivek-bombatkar / Spark-with-Python---My-learning-notes-
  ETL pipeline using pyspark (Spark - Python)
  ☆116Updated 5 years ago
• akashmehta10 / cdc_pyspark_hive
  ☆23Updated 2 years ago
• hyunjoonbok / PySpark
  PySpark functions and utilities with examples. Assists ETL process of data modeling
  ☆103Updated 4 years ago
• zhujun98 / data-engineering
  Spark, Airflow, Kafka
  ☆26Updated 2 years ago
• abulbasar / pyspark-examples
  Code examples on Apache Spark using python
  ☆107Updated 2 years ago
• Wittline / apache-spark-docker
  Dockerizing an Apache Spark Standalone Cluster
  ☆43Updated 2 years ago
• datyrlab / python-pyspark-framework
  pyspark framework
  ☆26Updated 3 years ago
• Aiven-Labs / python-notebooks-for-apache-kafka
  A Series of Notebooks on how to start with Kafka and Python
  ☆154Updated 3 months ago
• dogukannulu / airflow_kafka_cassandra_mongodb
  Produce Kafka messages, consume them and upload into Cassandra, MongoDB.
  ☆42Updated last year
• itversity / data-engineering-on-gcp
  Data Engineering on GCP
  ☆35Updated 2 years ago
• martandsingh / ApacheSpark
  This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…
  ☆98Updated 10 months ago
• dogukannulu / streaming_data_processing
  Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO
  ☆60Updated last year