Self-contained examples of Apache Spark streaming integrated with Apache Kafka.
☆198Apr 15, 2018Updated 7 years ago
Alternatives and similar repositories for spark-streaming-with-kafka
Users that are interested in spark-streaming-with-kafka are comparing it to the libraries listed below
Sorting:
- Spark Structured Streaming / Kafka / Cassandra / Elastic☆186Feb 7, 2023Updated 3 years ago
- Simple examle for Spark Streaming over Kafka topic☆108Oct 13, 2020Updated 5 years ago
- Scala examples for learning to use Spark☆445Sep 17, 2020Updated 5 years ago
- Spark with Scala example projects☆34Apr 17, 2019Updated 6 years ago
- Spark structured streaming with Kafka data source and writing to Cassandra☆63Dec 5, 2019Updated 6 years ago
- DirectKafka examples for Spark Streaming : 1. with checkpointing 2. Custom offset management☆60Sep 9, 2016Updated 9 years ago
- spark流数据处理，可以从flume-ng，kafka接收数据☆11Sep 16, 2015Updated 10 years ago
- The Internals of Spark Structured Streaming☆422Mar 2, 2026Updated last week
- 四川大学拓思爱诺用户session行为数据离线分析项目☆68Jul 1, 2022Updated 3 years ago
- High Performance Kafka Connector for Spark Streaming.Supports Multi Topic Fetch, Kafka Security. Reliable offset management in Zookeeper.…☆636Feb 26, 2022Updated 4 years ago
- Ansible playbooks to help to deploy Apache Hadoop,Spark,Storm,Zookeeper,Elasticsearch,Azkaban,Flume,Hbase,Kafka,Kibana,Logstash☆10Mar 21, 2017Updated 8 years ago
- Apache Spark and Apache Kafka integration example☆124Dec 21, 2017Updated 8 years ago
- A sink to save Spark Structured Streaming DataFrame into Hive table☆30Apr 16, 2018Updated 7 years ago
- Profiling Spark Applications for Performance Comparison and Diagnosis☆17Nov 11, 2018Updated 7 years ago
- Getting started with Spark, Spark streaming, Spark SQL and DataFrame.☆48May 15, 2018Updated 7 years ago
- Examples of Spark 2.0☆212Aug 11, 2021Updated 4 years ago
- 用户画像代码，根据算法推算出用户的性别和年龄比率☆11Dec 18, 2017Updated 8 years ago
- Write your Spark data to Kafka seamlessly☆174Jul 10, 2024Updated last year
- ☆14Nov 3, 2016Updated 9 years ago
- Self-contained examples using Apache Spark with the functional features of Java 8☆66Apr 8, 2018Updated 7 years ago
- Developing Spark External Data Sources using the V2 API☆48Apr 29, 2018Updated 7 years ago
- A Spark Streaming App to analyze the popular hashtags based on keywords☆24Feb 26, 2017Updated 9 years ago
- Hive,Pig,Hbase,Sqoop examples☆15Apr 24, 2017Updated 8 years ago
- Tweet Analysis with Spark☆14Aug 28, 2017Updated 8 years ago
- ☆243Jun 14, 2018Updated 7 years ago
- This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.☆40Aug 31, 2016Updated 9 years ago
- Master complex big data processing, stream analytics, and machine learning with Apache Spark☆18Jan 30, 2023Updated 3 years ago
- Recipes and examples for Apache Spark☆13Jan 21, 2015Updated 11 years ago
- Educational notes,Hands on problems w/ solutions for hadoop ecosystem☆87Jan 22, 2019Updated 7 years ago
- Docker Image and Kubernetes Configurations for Spark 2.x☆41Oct 27, 2019Updated 6 years ago
- Learning Apache spark,including code and data .Most part can run local.☆598Nov 4, 2021Updated 4 years ago
- 封装sparkstreaming动态调节batch time(有数据就执行计算)； 支持运行过程中增删topic； 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。☆181Apr 15, 2021Updated 4 years ago
- Apache Spark™ and Scala Workshops☆265Jul 29, 2024Updated last year
- Nested Data (JSON/AVRO/XML) Parsing and Flattening in Spark☆16Jan 22, 2024Updated 2 years ago
- Spark2.4.0 学习笔记分享☆199Jan 18, 2019Updated 7 years ago
- The Internals of Apache Spark☆1,541Jul 5, 2025Updated 8 months ago
- Learning Flink : Flink CEP,Flink Core,Flink SQL☆73Feb 21, 2022Updated 4 years ago
- SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失☆44Aug 2, 2017Updated 8 years ago
- ☆105Nov 26, 2019Updated 6 years ago