Alternatives and similar repositories for spark-structured-streaming:

Users that are interested in spark-structured-streaming are comparing it to the libraries listed below

• dogukannulu / streaming_data_processing
  Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO
  ☆60Updated last year
• pran4ajith / spark-twitter-streaming
  A real-time streaming ETL pipeline for streaming and performing sentiment analysis on Twitter data using Apache Kafka, Apache Spark and D…
  ☆30Updated 4 years ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆40Updated 8 months ago
• guoliveira / data-engineer-zoomcamp-project
  ☆38Updated 2 years ago
• KentHsu / Udacity-Data-Engineering-Nanodgree
  Udacity Data Engineering Nanodegree Program
  ☆52Updated 4 years ago
• itversity / data-engineering-spark
  ☆87Updated 2 years ago
• indiacloudtv / pyspark_on_google_colab
  PySpark Tutorial for Beginners on Google Colab: Hands-On Guide
  ☆16Updated 4 years ago
• airscholar / SparkingFlow
  This project demonstrates how to use Apache Airflow to submit jobs to Apache spark cluster in different programming laguages using Python…
  ☆42Updated last year
• HamzaG737 / data-engineering-project
  End to end data engineering project with kafka, airflow, spark, postgres and docker.
  ☆86Updated last week
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆99Updated 9 months ago
• dogukannulu / airflow_kafka_cassandra_mongodb
  Produce Kafka messages, consume them and upload into Cassandra, MongoDB.
  ☆40Updated last year
• subhamkharwal / ease-with-apache-spark
  Series follows learning from Apache Spark (PySpark) with quick tips and workaround for daily problems in hand
  ☆48Updated last year
• LearningJournal / Spark-Streaming-In-Python
  Apache Spark 3 - Structured Streaming Course Material
  ☆121Updated last year
• indiacloudtv / structuredstreamingkafkapyspark
  Apche Spark Structured Streaming with Kafka using Python(PySpark)
  ☆41Updated 5 years ago
• airscholar / e2e-data-engineering
  An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Ka…
  ☆238Updated last month
• PacktPublishing / Data-Engineering-with-Apache-Spark-Delta-Lake-and-Lakehouse
  Data Engineering with Spark and Delta Lake
  ☆96Updated 2 years ago
• datyrlab / python-pyspark-framework
  pyspark framework
  ☆25Updated 3 years ago
• zhujun98 / data-engineering
  Spark, Airflow, Kafka
  ☆26Updated last year
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆46Updated 2 years ago
• MBKraus / incremental_training
  Repo that relates to the Medium blog 'Keeping your ML model in shape with Kafka, Airflow' and MLFlow'
  ☆119Updated last year
• ismaildawoodjee / aws-data-pipeline
  A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…
  ☆21Updated 2 years ago
• immu0001 / Udacity-Data-Engineer-nanodegree
  Classwork projects and home works done through Udacity data engineering nano degree
  ☆74Updated last year
• airscholar / FlinkCommerce
  This repository contains an Apache Flink application for real-time sales analytics built using Docker Compose to orchestrate the necessar…
  ☆43Updated last year
• hyunjoonbok / PySpark
  PySpark functions and utilities with examples. Assists ETL process of data modeling
  ☆100Updated 4 years ago
• raveendratal / ravi_azureadbadf
  Ravi Azure ADB ADF Repository
  ☆65Updated 2 months ago
• dbusteed / kafka-spark-streaming-example
  ☆37Updated 5 years ago
• magogate / DataWarehouse_And_Reporting
  ☆45Updated 4 years ago
• Aiven-Labs / python-notebooks-for-apache-kafka
  A Series of Notebooks on how to start with Kafka and Python
  ☆154Updated last month
• ongxuanhong / de02-pyspark-optimization
  ☆14Updated 2 years ago
• danieldiamond / data-engineering-capstone
  Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development
  ☆21Updated 5 years ago