Alternatives and similar repositories for kafka-spark-streaming-example:

Users that are interested in kafka-spark-streaming-example are comparing it to the libraries listed below

• LearningJournal / Spark-Streaming-In-Python
  Apache Spark 3 - Structured Streaming Course Material
  ☆121Updated last year
• pran4ajith / spark-twitter-streaming
  A real-time streaming ETL pipeline for streaming and performing sentiment analysis on Twitter data using Apache Kafka, Apache Spark and D…
  ☆30Updated 4 years ago
• yennanliu / NYC_Taxi_Pipeline
  Design/Implement stream/batch architecture on NYC taxi data | #DE
  ☆25Updated 3 years ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆99Updated 9 months ago
• indiacloudtv / structuredstreamingkafkapyspark
  Apche Spark Structured Streaming with Kafka using Python(PySpark)
  ☆41Updated 5 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆53Updated last year
• itversity / data-engineering-spark
  ☆87Updated 2 years ago
• ysfesr / Building-Data-LakeHouse
  Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data
  ☆45Updated last year
• dbusteed / spark-structured-streaming
  ☆33Updated 4 years ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆40Updated 8 months ago
• SatadruMukherjee / Data-Preprocessing-Models
  ☆64Updated last week
• Aiven-Labs / python-notebooks-for-apache-kafka
  A Series of Notebooks on how to start with Kafka and Python
  ☆154Updated last month
• sankamuk / PysparkCheatsheet
  PySpark Cheatsheet
  ☆36Updated 2 years ago
• yTek01 / docker-spark-airflow
  ☆36Updated 2 years ago
• damklis / etljob
  Simple ETL pipeline using Python
  ☆25Updated last year
• indiacloudtv / pyspark_on_google_colab
  PySpark Tutorial for Beginners on Google Colab: Hands-On Guide
  ☆16Updated 4 years ago
• marclamberti / airflow-eks-helm-chart
  Airflow helm chart for AWS EKS
  ☆18Updated 4 years ago
• josephmachado / spark_submit_airflow
  Simple repo to demonstrate how to submit a spark job to EMR from Airflow
  ☆33Updated 4 years ago
• BenSchr / Udacity-Data-Engineering-Projects
  My solutions for the Udacity Data Engineering Nanodegree
  ☆33Updated 5 years ago
• tatwan / airflow-spark-aws-emr
  ☆11Updated 4 years ago
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆46Updated 2 years ago
• LearningJournal / Spark-Streaming-In-Scala
  Apache Spark 3 - Structured Streaming Course Material
  ☆45Updated 4 years ago
• garystafford / tickit-data-lake-demo
  Resources for video demonstrations and blog posts related to DataOps on AWS
  ☆172Updated 3 years ago
• josephmachado / bitcoinMonitor
  Near real time ETL to populate a dashboard.
  ☆73Updated 9 months ago
• ajupton / big-data-engineering-project
  Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR
  ☆82Updated 5 years ago
• jamesbyars / apache-spark-etl-pipeline-example
  Demonstration of using Apache Spark to build robust ETL pipelines while taking advantage of open source, general purpose cluster computin…
  ☆24Updated last year
• dogukannulu / streaming_data_processing
  Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO
  ☆59Updated last year
• yennanliu / DE-100-days
  data engineering 100 days 🤖 🧲 🦾 | #DE
  ☆40Updated last year
• guidok91 / spark-movies-etl
  Spark data pipeline that processes movie ratings data.
  ☆28Updated this week
• zhujun98 / data-engineering
  Spark, Airflow, Kafka
  ☆26Updated last year