Kafka stream for Spark with storage of the offsets in ZooKeeper
☆60Apr 18, 2017Updated 8 years ago
Alternatives and similar repositories for spark-kafka-source
Users that are interested in spark-kafka-source are comparing it to the libraries listed below
Sorting:
- Code for processing AVRO data in Spark Streaming + Kafka (DirectKafka approach with custom offset management in zookeeper)☆29Sep 9, 2016Updated 9 years ago
- ☆243Jun 14, 2018Updated 7 years ago
- 使用shell脚本部署Apache Doris (incubating) FE & BE☆11Jul 8, 2019Updated 6 years ago
- Example of use of Spark Streaming with Kafka☆90Jul 11, 2014Updated 11 years ago
- Pinot 是一个实时分布式的 OLAP 数据存储和分析系统。LinkedIn 使用它实现低延迟可伸缩的实时分析。Pinot 从离线数据源（包括 Hadoop 和各类文件）和在线数据源（如 Kafka）中攫取数据进行分析。Pinot 被设计是可以进行水平扩展的☆16Nov 8, 2015Updated 10 years ago
- High Performance Kafka Connector for Spark Streaming.Supports Multi Topic Fetch, Kafka Security. Reliable offset management in Zookeeper.…☆636Feb 26, 2022Updated 4 years ago
- Spark(multi versions) + Streaming/Hive/SQL/UDF Demos☆15May 17, 2018Updated 7 years ago
- Write your Spark data to Kafka seamlessly☆174Jul 10, 2024Updated last year
- 基于 spark 混合查询平台，支持不同源数据库的联合查询，mysql hive presto ...☆14Aug 3, 2017Updated 8 years ago
- real time log event processing using spark, kafka & cassandra☆13Dec 4, 2014Updated 11 years ago
- A Real-Time Analytical Processing (RTAP) example using Spark/Shark☆51Feb 21, 2014Updated 12 years ago
- A Node.js REST interface for an Apache Spark REPL which can execute JavaScript.☆17Mar 21, 2016Updated 9 years ago
- This project is a unified ETL platform that support various data processing technologies, including Spark, Hive, Hadoop, Python, Linux Sh…☆17Oct 16, 2015Updated 10 years ago
- DirectKafka examples for Spark Streaming : 1. with checkpointing 2. Custom offset management☆60Sep 9, 2016Updated 9 years ago
- something to help you spark☆19Jul 5, 2017Updated 8 years ago
- spark实例代码☆78Nov 11, 2017Updated 8 years ago
- Simple Lambda Architecture implementation based on Apache Spark (Core, SQL, Streaming)☆40Feb 19, 2017Updated 9 years ago
- This application comes as Spark2.1-as-Service-Provider using an embedded, Reactive-Streams-based, fully asynchronous HTTP server☆50Jul 16, 2023Updated 2 years ago
- Java调用Kettle API执行转换和作业，Java代码生成Kettle转换。☆21Mar 9, 2018Updated 7 years ago
- Ingress data from kafka topic into clickhouse table (JSON format)☆24Apr 12, 2018Updated 7 years ago
- Example usage of spark cassandra connector☆24Nov 21, 2014Updated 11 years ago
- Project for reading data from kafka and writing to kafka and HBase with kerberos☆24Dec 8, 2016Updated 9 years ago
- ☆24Apr 29, 2016Updated 9 years ago
- An introduction of Scala learning and some frequently asked questions(FAQ);有关Scala的学习笔记，记录Scala的常用语法及标准库的部分设计原理☆26May 12, 2016Updated 9 years ago
- PoC application for Microservice Architecture Pattern☆10Jul 14, 2017Updated 8 years ago
- 实时分析nginx日志，计算接口访问次数，uv，时延，异常IP等指标☆29Apr 14, 2017Updated 8 years ago
- 记录Spark、Flink研究经验☆26Aug 11, 2019Updated 6 years ago
- Spark structured streaming with Kafka data source and writing to Cassandra☆63Dec 5, 2019Updated 6 years ago
- Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌☆29May 15, 2020Updated 5 years ago
- Apache Spark and Apache Kafka integration example☆124Dec 21, 2017Updated 8 years ago
- Some extra directives and other things for akka-http projects☆31Oct 29, 2017Updated 8 years ago
- Serviceframework一个简单但灵活的模块引擎☆31Jun 29, 2017Updated 8 years ago
- A desktop application for learning and practicing scales and chords on the piano.☆15Sep 5, 2025Updated 6 months ago
- 基于Spark的实时推荐系统,使用MovieLens作为测试数据集☆28Dec 16, 2022Updated 3 years ago
- ☆15Apr 22, 2014Updated 11 years ago
- Real Time Analytics and Data Pipelines based on Spark Streaming☆531Oct 24, 2019Updated 6 years ago
- Large-scale event processing with Akka Persistence and Apache Spark☆273Jun 18, 2016Updated 9 years ago
- A shell script to automate the operations of sqoop☆11Mar 29, 2021Updated 4 years ago
- Interplanetary Database: A Database built on top of IPFS and made immutable using Ethereum blockchain.☆10Sep 19, 2022Updated 3 years ago