手动管理spark streaming集成kafka的数据偏移量到zookeeper中
☆21Jul 6, 2018Updated 7 years ago
Alternatives and similar repositories for sparkStreaming-offset-to-zk
Users that are interested in sparkStreaming-offset-to-zk are comparing it to the libraries listed below
Sorting:
- 请求spark rest API获取applications，jobs，stages，executors，rdds，streaming，environment等信息提供监控和报警服务☆11Nov 22, 2018Updated 7 years ago
- SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失☆44Aug 2, 2017Updated 8 years ago
- 封装sparkstreaming动态调节batch time(有数据就执行计算)； 支持运行过程中增删topic； 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。☆181Apr 15, 2021Updated 4 years ago
- 一个手动管理spark streaming集成kafka时的偏移量到zookeeper中的小项目☆133Dec 17, 2025Updated 2 months ago
- fusioninsight_ecosystem☆26May 11, 2022Updated 3 years ago
- SparkSQL数据分析案例☆23Dec 3, 2016Updated 9 years ago
- spark将hdfs数据高性能灌入kafka，然后spark streaming/structured streaming高速消费，关注性能，欢迎提供性能/代码优化建议☆32Mar 24, 2019Updated 6 years ago
- Code for processing AVRO data in Spark Streaming + Kafka (DirectKafka approach with custom offset management in zookeeper)☆29Sep 9, 2016Updated 9 years ago
- spring-boot利用scala写spark程序骨架☆28Oct 22, 2019Updated 6 years ago
- Spark Streaming监控平台，支持任务部署与告警、自启动☆129Mar 29, 2018Updated 7 years ago
- Streaming Analytics platform, built with Apache Flink and Kafka☆36Oct 6, 2023Updated 2 years ago
- 使用springboot+mybatis后台框架 前端bootstrap框架 添加web socket实时提醒订单消息 使用springsecurity进行权限拦截 邮箱+短信验证 ，echart图表显示用户订单信息，poi表报打印等等。。。☆12Oct 25, 2017Updated 8 years ago
- 基于Flink流处理的动态实时亿级全端用户画像系统可视化界面☆36Dec 9, 2022Updated 3 years ago
- spark实例代码☆78Nov 11, 2017Updated 8 years ago
- A shell script to automate the operations of sqoop☆11Mar 29, 2021Updated 4 years ago
- A draggablegrid layout☆10Aug 10, 2022Updated 3 years ago
- MCP = Multiple source Convert Platform☆11Aug 2, 2022Updated 3 years ago
- 华为软件精英挑战赛2019，实时计算全图路况，每辆车在每个时刻(或隔几个时刻)根据自身信息生成自己的权重矩阵，利用SPFA算法动态规划路径☆10Apr 14, 2019Updated 6 years ago
- 晋江文学城大数据分析项目☆11Jul 6, 2019Updated 6 years ago
- 深度学习之神经网络核心原理与算法-课程学习相关代码☆12Aug 18, 2018Updated 7 years ago
- 代码生成工具<主要生成xml，model，service，controller以及sql文件工具类>☆41Jul 3, 2017Updated 8 years ago
- 本工程主要解决在IOS内加载3D模型的问题☆11Mar 9, 2015Updated 11 years ago
- 批量处理小工具：①批量将word文档转换为pdf②给pdf文档批量添加水印☆12May 11, 2022Updated 3 years ago
- POC for all the stack of big data (kafka, spark, cassandra, hdfs, docker, springboot)☆12Dec 16, 2022Updated 3 years ago
- 用户画像代码，根据算法推算出用户的性别和年龄比率☆11Dec 18, 2017Updated 8 years ago
- 基于springbook+spark的机器学习应用开发☆12Nov 21, 2022Updated 3 years ago
- springmvc+phoenix操作hbase的web架构☆10Aug 20, 2018Updated 7 years ago
- JVM related exercises☆11Jul 16, 2017Updated 8 years ago
- Online ordering system combined with big data statistics☆10Jul 11, 2019Updated 6 years ago
- 使用shell脚本部署Apache Doris (incubating) FE & BE☆11Jul 8, 2019Updated 6 years ago
- Tools to estimate the correlation of different text-based evaluation measures for Automatic Image Description☆10Feb 2, 2017Updated 9 years ago
- ☆15Aug 25, 2014Updated 11 years ago
- Eddy Analytics user interface: resources manager, pipeline builder, and dashboard creator☆11Jan 18, 2023Updated 3 years ago
- echarts大屏展示得数据可视化☆11Sep 6, 2018Updated 7 years ago
- This repo demonstrates 3 ways for apps to auto reload from Kubernetes ConfigMap.☆12Jun 14, 2019Updated 6 years ago
- Apache Flink自述理解与代码☆13Mar 9, 2019Updated 7 years ago
- 数据仓库KETTLE ETL资源库☆14Jun 11, 2015Updated 10 years ago
- 在线编辑pdf文档☆11Jun 21, 2022Updated 3 years ago
- 微服务架构实战篇（五）：Spring boot2.x + Guava 并使用RateLimiter秒杀限流☆12Mar 14, 2019Updated 6 years ago