wangfengchao / sparkStreaming-offset-to-zkView external linksLinks
手动管理spark streaming集成kafka的数据偏移量到zookeeper中
☆21Jul 6, 2018Updated 7 years ago
Alternatives and similar repositories for sparkStreaming-offset-to-zk
Users that are interested in sparkStreaming-offset-to-zk are comparing it to the libraries listed below
Sorting:
- 请求spark rest API获取applications,jobs,stages,executors,rdds,streaming,environment等信息提供监控和报警服务☆11Nov 22, 2018Updated 7 years ago
- hive sql parser☆11Aug 27, 2014Updated 11 years ago
- SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失☆44Aug 2, 2017Updated 8 years ago
- 封装sparkstreaming动态调节batch time(有数据就执行计算); 支持运行过程中增删topic; 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。☆183Apr 15, 2021Updated 4 years ago
- 此工程采用SpringBoot + Mybatis + SparkSQL + Hive框架进行集成,支持Kerberos认证。☆21Mar 19, 2018Updated 7 years ago
- 一个手动管理spark streaming集成kafka时的偏移量到zookeeper中的小项目☆133Dec 17, 2025Updated last month
- SparkSQL数据分析案例☆23Dec 3, 2016Updated 9 years ago
- fusioninsight_ecosystem☆26May 11, 2022Updated 3 years ago
- spark将hdfs数据高性能灌入kafka,然后spark streaming/structured streaming高速消费,关注性能,欢迎提供性能/代码优化建议☆33Mar 24, 2019Updated 6 years ago
- spring-boot利用scala写spark程序骨架☆28Oct 22, 2019Updated 6 years ago
- Code for processing AVRO data in Spark Streaming + Kafka (DirectKafka approach with custom offset management in zookeeper)☆29Sep 9, 2016Updated 9 years ago
- Spark Streaming监控平台,支持任务部署与告警、自启动☆129Mar 29, 2018Updated 7 years ago
- 使用springboot+mybatis后台框架 前端bootstrap框架 添加web socket实时提醒订单消息 使用springsecurity进行权限拦截 邮箱+短信验证 ,echart图表显示用户订单信息,poi表报打印等等。。。☆12Oct 25, 2017Updated 8 years ago
- Streaming Analytics platform, built with Apache Flink and Kafka☆36Oct 6, 2023Updated 2 years ago
- 基于Flink流处理的动态实时亿级全端用户画像系统可视化界面☆36Dec 9, 2022Updated 3 years ago
- spark实例代码☆78Nov 11, 2017Updated 8 years ago
- 一个基于ElasticSearch的业务日志记录工具☆10Nov 5, 2018Updated 7 years ago
- 华为软件精英挑战赛2019,实时计算全图路况,每辆车在每个时刻(或隔几个时刻)根据自身信息生成自己的权重矩阵,利用SPFA算法动态规划路径☆10Apr 14, 2019Updated 6 years ago
- 襄阳智慧交通大数据平台建设☆15Jun 25, 2022Updated 3 years ago
- 深度学习之神经网络核心原理与算法-课程学习相关代码☆12Aug 18, 2018Updated 7 years ago
- A shell script to automate the operations of sqoop☆11Mar 29, 2021Updated 4 years ago
- A draggablegrid layout☆10Aug 10, 2022Updated 3 years ago
- 晋江文学城大数据分析项目☆11Jul 6, 2019Updated 6 years ago
- MCP = Multiple source Convert Platform☆11Aug 2, 2022Updated 3 years ago
- 使用SpringBoot开发的基于HBASE的大数据存储分布式云计算笔记(后端)☆34Mar 30, 2019Updated 6 years ago
- 代码生成工具<主要生成xml,model,service,controller以及sql文件工具类>☆41Jul 3, 2017Updated 8 years ago
- Tools to estimate the correlation of different text-based evaluation measures for Automatic Image Description☆10Feb 2, 2017Updated 9 years ago
- 基于springbook+spark的机器学习应用开发☆12Nov 21, 2022Updated 3 years ago
- ☆15Aug 25, 2014Updated 11 years ago
- JVM related exercises☆11Jul 16, 2017Updated 8 years ago
- POC for all the stack of big data (kafka, spark, cassandra, hdfs, docker, springboot)☆12Dec 16, 2022Updated 3 years ago
- 一个springboot访问sqlite的参考项目☆13Aug 28, 2018Updated 7 years ago
- springmvc+phoenix操作hbase的web架构☆10Aug 20, 2018Updated 7 years ago
- Build your own private auto agent using Octet.Chat.☆13Aug 6, 2025Updated 6 months ago
- Online ordering system combined with big data statistics☆10Jul 11, 2019Updated 6 years ago
- 在规格文件上直接执行SQL,无数 据库依赖,基于Java8的流计算和Lamdba表达式。☆10Jun 15, 2017Updated 8 years ago
- 用户画像代码,根据算法推算出用户的性别和年龄比率☆11Dec 18, 2017Updated 8 years ago
- 基于sqoop封装的一个通用的抽取工具,方便数据平台界面提交任务以及数据源管理☆10May 2, 2017Updated 8 years ago
- 使用shell脚本部署Apache Doris (incubating) FE & BE☆11Jul 8, 2019Updated 6 years ago