spirom / spark-streaming-with-kafkaView external linksLinks
Self-contained examples of Apache Spark streaming integrated with Apache Kafka.
☆199Apr 15, 2018Updated 7 years ago
Alternatives and similar repositories for spark-streaming-with-kafka
Users that are interested in spark-streaming-with-kafka are comparing it to the libraries listed below
Sorting:
- Spark Structured Streaming / Kafka / Cassandra / Elastic☆185Feb 7, 2023Updated 3 years ago
- Simple examle for Spark Streaming over Kafka topic☆108Oct 13, 2020Updated 5 years ago
- Scala examples for learning to use Spark☆445Sep 17, 2020Updated 5 years ago
- Spark with Scala example projects☆34Apr 17, 2019Updated 6 years ago
- Spark structured streaming with Kafka data source and writing to Cassandra☆63Dec 5, 2019Updated 6 years ago
- DirectKafka examples for Spark Streaming : 1. with checkpointing 2. Custom offset management☆60Sep 9, 2016Updated 9 years ago
- The Internals of Spark Structured Streaming☆422Jan 25, 2026Updated 3 weeks ago
- 四川大学拓思爱诺用户session行为数据离线分析项目☆68Jul 1, 2022Updated 3 years ago
- High Performance Kafka Connector for Spark Streaming.Supports Multi Topic Fetch, Kafka Security. Reliable offset management in Zookeeper.…☆636Feb 26, 2022Updated 3 years ago
- Ansible playbooks to help to deploy Apache Hadoop,Spark,Storm,Zookeeper,Elasticsearch,Azkaban,Flume,Hbase,Kafka,Kibana,Logstash☆10Mar 21, 2017Updated 8 years ago
- Apache Spark and Apache Kafka integration example☆124Dec 21, 2017Updated 8 years ago
- Profiling Spark Applications for Performance Comparison and Diagnosis☆17Nov 11, 2018Updated 7 years ago
- Getting started with Spark, Spark streaming, Spark SQL and DataFrame.☆48May 15, 2018Updated 7 years ago
- Examples of Spark 2.0☆212Aug 11, 2021Updated 4 years ago
- 用户画像代码，根据算法推算出用户的性别和年龄比率☆11Dec 18, 2017Updated 8 years ago
- spark实例代码☆78Nov 11, 2017Updated 8 years ago
- Write your Spark data to Kafka seamlessly☆174Jul 10, 2024Updated last year
- Self-contained examples using Apache Spark with the functional features of Java 8☆66Apr 8, 2018Updated 7 years ago
- Developing Spark External Data Sources using the V2 API☆48Apr 29, 2018Updated 7 years ago
- Tweet Analysis with Spark☆14Aug 28, 2017Updated 8 years ago
- Hive,Pig,Hbase,Sqoop examples☆15Apr 24, 2017Updated 8 years ago
- This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.☆40Aug 31, 2016Updated 9 years ago
- A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python,…☆210Feb 1, 2019Updated 7 years ago
- Recipes and examples for Apache Spark☆13Jan 21, 2015Updated 11 years ago
- 基于 spark 混合查询平台，支持不同源数据库的联合查 询，mysql hive presto ...☆14Aug 3, 2017Updated 8 years ago
- Master complex big data processing, stream analytics, and machine learning with Apache Spark☆18Jan 30, 2023Updated 3 years ago
- Educational notes,Hands on problems w/ solutions for hadoop ecosystem☆87Jan 22, 2019Updated 7 years ago
- Docker Image and Kubernetes Configurations for Spark 2.x☆41Oct 27, 2019Updated 6 years ago
- Learning Apache spark,including code and data .Most part can run local.☆598Nov 4, 2021Updated 4 years ago
- 封装sparkstreaming动态调节batch time(有数据就执行计算)； 支持运行过程中增删topic； 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。☆183Apr 15, 2021Updated 4 years ago
- Apache Spark™ and Scala Workshops☆264Jul 29, 2024Updated last year
- Nested Data (JSON/AVRO/XML) Parsing and Flattening in Spark☆16Jan 22, 2024Updated 2 years ago
- Spark2.4.0 学习笔记分享☆199Jan 18, 2019Updated 7 years ago
- The Internals of Apache Spark☆1,538Jul 5, 2025Updated 7 months ago
- Learning Flink : Flink CEP,Flink Core,Flink SQL☆73Feb 21, 2022Updated 3 years ago
- SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失☆44Aug 2, 2017Updated 8 years ago
- ☆105Nov 26, 2019Updated 6 years ago
- Spark Streaming HBase Example☆94Apr 4, 2016Updated 9 years ago
- Learning PySpark video series☆11Mar 5, 2018Updated 7 years ago