Simple examle for Spark Streaming over Kafka topic
☆108Oct 13, 2020Updated 5 years ago
Alternatives and similar repositories for kafka-spark-streaming-example
Users that are interested in kafka-spark-streaming-example are comparing it to the libraries listed below
Sorting:
- Self-contained examples of Apache Spark streaming integrated with Apache Kafka.☆198Apr 15, 2018Updated 7 years ago
- Spark Structured Streaming / Kafka / Cassandra / Elastic☆186Feb 7, 2023Updated 3 years ago
- Apache Spark and Apache Kafka integration example☆124Dec 21, 2017Updated 8 years ago
- Scalable CDC Pattern Implemented using PySpark☆18Oct 8, 2025Updated 5 months ago
- High Performance Kafka Connector for Spark Streaming.Supports Multi Topic Fetch, Kafka Security. Reliable offset management in Zookeeper.…☆636Feb 26, 2022Updated 4 years ago
- Spark Streaming example project which pulls messages from Kafka and write to HBase Table.☆11Jul 5, 2015Updated 10 years ago
- Self-contained examples using Apache Spark with the functional features of Java 8☆66Apr 8, 2018Updated 7 years ago
- Streaming 相关项目☆15Mar 27, 2017Updated 8 years ago
- This project compose of two parts: 1) write, spark job to write to hbase using bulk load to; 2)read, rest api reading from hbase base on …☆20Oct 25, 2017Updated 8 years ago
- Schema Registry integration for Apache Spark☆40Nov 16, 2022Updated 3 years ago
- kafka spark hbase 日志统计☆82Dec 23, 2016Updated 9 years ago
- Drawbridge is a lightweight API gateway written in Go☆12Apr 18, 2020Updated 5 years ago
- High Performance Spark Streaming with Direct Kafka in Java☆39Sep 14, 2016Updated 9 years ago
- Code samples from DataStax☆30Mar 20, 2023Updated 2 years ago
- A minimal seed template for an Akka gRPC with Scala build☆19Jan 22, 2026Updated last month
- This is a real-time dashboard example using Spark Streaming and Node.js☆26Dec 17, 2025Updated 2 months ago
- ☆14Nov 16, 2022Updated 3 years ago
- ☆10May 27, 2016Updated 9 years ago
- Learning Flink : Flink CEP,Flink Core,Flink SQL☆73Feb 21, 2022Updated 4 years ago
- Implementation of a Big Data (batch and stream) distributed processing engine in Java using Akka actors.☆12Feb 20, 2023Updated 3 years ago
- An example project using Spark Streaming with Kafka message and Avro serialization☆12Aug 21, 2015Updated 10 years ago
- An example project for Kafka and Spark Streaming integration☆11Apr 21, 2023Updated 2 years ago
- A consumer of a Kafka topic based on Flink☆12Oct 5, 2022Updated 3 years ago
- 本工程是一个基于spring,mybatis,redis 和maven的练习demo,在此demo中连接了两个mysql数据库,一个redis库。IDE是myeclipse☆14Nov 20, 2012Updated 13 years ago
- ☆14Nov 3, 2016Updated 9 years ago
- ☆12May 11, 2016Updated 9 years ago
- 解析Mysql binlog日志并发至Kafka☆23Nov 25, 2016Updated 9 years ago
- Java 8 and Spark learning through examples☆43Nov 10, 2017Updated 8 years ago
- Code used in "Pro Spark Streaming: The Zen of Real-time Analytics using Apache Spark" published by Apress Publishing.☆48Mar 27, 2016Updated 9 years ago
- SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失☆44Aug 2, 2017Updated 8 years ago
- notebooks for nlp-on-spark☆13Jan 27, 2017Updated 9 years ago
- Showing the relationship between ImageNet ID and labels and pytorch pre-trained model output ID and labels☆10Oct 11, 2020Updated 5 years ago
- spark流数据处理,可以从flume-ng,kafka接收数据☆11Sep 16, 2015Updated 10 years ago
- ☆11May 31, 2018Updated 7 years ago
- Apache-kafka-spark-streaming-poc☆10Mar 19, 2017Updated 8 years ago
- spark实例代码☆78Nov 11, 2017Updated 8 years ago
- Spark1.6和spark2.2的示例,包含kafka,flume,structuredstreaming,jedis,elasticsearch,mysql,dataframe☆15Jan 28, 2018Updated 8 years ago
- Test for SparkSQL ScalaPB☆14Jun 28, 2022Updated 3 years ago
- Lab project to showcase Flink's performance differences between using a SQL query and implementing the same logic via the DataStream API☆14Apr 15, 2020Updated 5 years ago