Simple examle for Spark Streaming over Kafka topic
☆106Oct 13, 2020Updated 6 years ago
Alternatives and similar repositories for kafka-spark-streaming-example
Users that are interested in kafka-spark-streaming-example are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Self-contained examples of Apache Spark streaming integrated with Apache Kafka.☆196Apr 15, 2018Updated 8 years ago
- Apache Spark and Apache Kafka integration example☆121Dec 21, 2017Updated 8 years ago
- Spark Structured Streaming / Kafka / Cassandra / Elastic☆185Feb 7, 2023Updated 3 years ago
- Spark structured streaming with Kafka data source and writing to Cassandra☆62Dec 5, 2019Updated 6 years ago
- High Performance Kafka Connector for Spark Streaming.Supports Multi Topic Fetch, Kafka Security. Reliable offset management in Zookeeper.…☆630Apr 24, 2026Updated 6 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- An example project using Spark Streaming with Kafka message and Avro serialization☆12Aug 21, 2015Updated 11 years ago
- This project compose of two parts: 1) write, spark job to write to hbase using bulk load to; 2)read, rest api reading from hbase base on …☆20Oct 25, 2017Updated 9 years ago
- Scalable CDC Pattern Implemented using PySpark☆18Oct 8, 2025Updated last year
- Streaming 相关项目☆15Mar 27, 2017Updated 9 years ago
- kafka spark hbase 日志统计☆82Dec 23, 2016Updated 9 years ago
- A simple pool for Kafka Producers☆13Feb 2, 2015Updated 11 years ago
- Schema Registry integration for Apache Spark☆40Nov 16, 2022Updated 3 years ago
- A light Kafka to HDFS/S3 ETL library based on Apache Spark☆40Jun 29, 2017Updated 9 years ago
- Learning Spark SQL, published by Packt☆43Jan 30, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Code used in "Pro Spark Streaming: The Zen of Real-time Analytics using Apache Spark" published by Apress Publishing.☆47Mar 27, 2016Updated 10 years ago
- Java 8 and Spark learning through examples☆42Nov 10, 2017Updated 8 years ago
- A proxy behind nginx while before kibana (4.x, 5.x) to provide data isolation for different users☆23May 6, 2019Updated 7 years ago
- This repository contains code for Spark Streaming☆27Mar 11, 2021Updated 5 years ago
- ☆12May 11, 2016Updated 10 years ago
- Simple application implementing Change Data Capture using Kafka Streams.☆19Dec 31, 2019Updated 6 years ago
- Self-contained examples using Apache Spark with the functional features of Java 8☆65Apr 8, 2018Updated 8 years ago
- ☆11May 31, 2018Updated 8 years ago
- High Performance Spark Streaming with Direct Kafka in Java☆39Sep 14, 2016Updated 10 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- 基于Netty和MQTT协议的IM组件☆10Dec 16, 2022Updated 3 years ago
- Profiling Spark Applications for Performance Comparison and Diagnosis☆16Nov 11, 2018Updated 7 years ago
- A minimal seed template for an Akka gRPC with Scala build☆19Oct 9, 2026Updated 2 weeks ago
- An example project for Kafka and Spark Streaming integration☆11Apr 21, 2023Updated 3 years ago
- A Spark Reliability Testing Suite☆13Jan 10, 2017Updated 9 years ago
- flink-cep☆17Nov 18, 2018Updated 7 years ago
- Getting started with Spark, Spark Streaming, Spark SQL, DataFrame☆36Apr 24, 2016Updated 10 years ago
- Distributed SQL query engine for running interactive analytic queries against big data sources.☆10Jul 1, 2016Updated 10 years ago
- ☆10May 27, 2016Updated 10 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失☆43Aug 2, 2017Updated 9 years ago
- A library to simplify compound field partitioning, sorting and grouping in MapReduce.☆12Nov 14, 2014Updated 11 years ago
- Lab project to showcase Flink's performance differences between using a SQL query and implementing the same logic via the DataStream API☆14Apr 15, 2020Updated 6 years ago
- Spark1.6和spark2.2的示例，包含kafka,flume,structuredstreaming,jedis,elasticsearch,mysql,dataframe☆15Oct 19, 2026Updated last week
- Spring style templates for Kafka☆11Aug 8, 2012Updated 14 years ago
- This is a real-time dashboard example using Spark Streaming and Node.js☆25Dec 17, 2025Updated 10 months ago
- Scala examples for learning to use Spark☆441Sep 17, 2020Updated 6 years ago