Code for processing AVRO data in Spark Streaming + Kafka (DirectKafka approach with custom offset management in zookeeper)
☆29Sep 9, 2016Updated 9 years ago
Alternatives and similar repositories for Avro-SparkStreaming-Kafka
Users that are interested in Avro-SparkStreaming-Kafka are comparing it to the libraries listed below
Sorting:
- SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失☆44Aug 2, 2017Updated 8 years ago
- Kafka stream for Spark with storage of the offsets in ZooKeeper☆60Apr 18, 2017Updated 8 years ago
- Spark 3.0.0 Structured Streaming Kafka Avro Demo☆15Apr 21, 2023Updated 2 years ago
- DirectKafka examples for Spark Streaming : 1. with checkpointing 2. Custom offset management☆60Sep 9, 2016Updated 9 years ago
- A light Kafka to HDFS/S3 ETL library based on Apache Spark☆40Jun 29, 2017Updated 8 years ago
- 手动管理spark streaming集成kafka的数据偏移量到zookeeper中☆21Jul 6, 2018Updated 7 years ago
- Project for reading data from kafka and writing to kafka and HBase with kerberos☆24Dec 8, 2016Updated 9 years ago
- PoC application for Microservice Architecture Pattern☆10Jul 14, 2017Updated 8 years ago
- 使用spark streaming 导入kafka数据到hbase☆25Apr 14, 2016Updated 9 years ago
- Real Time Analytics and Data Pipelines based on Spark Streaming☆531Oct 24, 2019Updated 6 years ago
- 记录Spark、Flink研究经验☆26Aug 11, 2019Updated 6 years ago
- Ambari stack for easily installing and managing Mongo DB on HDP cluster☆24May 23, 2016Updated 9 years ago
- A Spark SQL HBase connector☆29May 4, 2015Updated 10 years ago
- Spark structured streaming with Kafka data source and writing to Cassandra☆63Dec 5, 2019Updated 6 years ago
- High performance HBase / Spark SQL engine☆28Jul 7, 2022Updated 3 years ago
- 杭州第六次 Spark & Flink Meetup☆30May 14, 2018Updated 7 years ago
- 分布式任务调度框架教程, 包括: Quartz、Elastic-Job和TBSchedule.☆32Mar 4, 2019Updated 7 years ago
- Ambari Service for OpenTSDB☆34Dec 14, 2016Updated 9 years ago
- Companion Code for Using Flume Book☆32May 27, 2015Updated 10 years ago
- SparkOnHBase☆278Mar 30, 2021Updated 4 years ago
- Apache Spark’s classic Word Count example with Spring Boot.☆11Apr 21, 2023Updated 2 years ago
- A document tool build on Vue.☆10May 13, 2016Updated 9 years ago
- Schema Registry integration for Apache Spark☆40Nov 16, 2022Updated 3 years ago
- 一个手动管理spark streaming集成kafka时的偏移量到zookeeper中的小项目☆133Dec 17, 2025Updated 2 months ago
- Golang Web Toolkit☆16Nov 5, 2011Updated 14 years ago
- An alternative to OpenFaaS nats-queue-worker for long-running functions☆11Dec 14, 2022Updated 3 years ago
- code repository for Deep learning for NLP using Python (v), Published by Packt☆11Jan 15, 2021Updated 5 years ago
- Port of Msmq to VS2013 with 64 bit support☆11Oct 26, 2016Updated 9 years ago
- ☆11Dec 6, 2017Updated 8 years ago
- A wrapper for applications to help with running Istio Sidecars☆11Feb 17, 2026Updated 2 weeks ago
- MongoDB extension for k6 - High-performance load testing with MongoDB support☆14Updated this week
- an one-click-installer shell script helping openSUSE new starters ( especially from China ) to install various applications including mul…☆11Jul 26, 2015Updated 10 years ago
- elasticsearch reader and writer plugin for datax☆39Aug 31, 2017Updated 8 years ago
- Open-source distribute workflow schedule tools, also support streaming task.☆39Nov 11, 2017Updated 8 years ago
- Custom state store providers for Apache Spark☆92Feb 14, 2025Updated last year
- Encapsulated spark 与其他组件的结合api，方便使用，例如 es，hbase，kudu，kafka，mq等☆35Dec 18, 2019Updated 6 years ago
- ☆243Jun 14, 2018Updated 7 years ago
- Total Anomaly Detection System for software logs and traces☆10Dec 7, 2015Updated 10 years ago
- Ambari service for RedHat FreeIPA☆11Sep 30, 2016Updated 9 years ago