手动管理spark streaming集成kafka的数据偏移量到zookeeper中
☆21Jul 6, 2018Updated 7 years ago
Alternatives and similar repositories for sparkStreaming-offset-to-zk
Users that are interested in sparkStreaming-offset-to-zk are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 请求spark rest API获取applications，jobs，stages，executors，rdds，streaming，environment等信息提供监控和报警服务☆11Nov 22, 2018Updated 7 years ago
- SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失☆43Aug 2, 2017Updated 8 years ago
- hive sql parser☆11Aug 27, 2014Updated 11 years ago
- Code for processing AVRO data in Spark Streaming + Kafka (DirectKafka approach with custom offset management in zookeeper)☆29Sep 9, 2016Updated 9 years ago
- 此工程采用SpringBoot + Mybatis + SparkSQL + Hive框架进行集成，支持Kerberos认证。☆21Mar 19, 2018Updated 8 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 一个手动管理spark streaming集成kafka时的偏移量到zookeeper中的小项目☆133Dec 17, 2025Updated 4 months ago
- SparkSQL数据分析案例☆23Dec 3, 2016Updated 9 years ago
- 封装sparkstreaming动态调节batch time(有数据就执行计算)； 支持运行过程中增删topic； 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。☆181Apr 15, 2021Updated 5 years ago
- spark将hdfs数据高性能灌入kafka，然后spark streaming/structured streaming高速消费，关注性能，欢迎提供性能/代码优化建议☆32Mar 24, 2019Updated 7 years ago
- 简单易用的ETL工具☆17Mar 28, 2019Updated 7 years ago
- spark实例代码☆78Nov 11, 2017Updated 8 years ago
- spark学习中文笔记☆13Mar 26, 2019Updated 7 years ago
- Spark Streaming监控平台，支持任务部署与告警、自启动☆129Mar 29, 2018Updated 8 years ago
- fusioninsight_ecosystem☆26May 11, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- High-availably monitor for Apache Kudu by Prometheus☆15Aug 17, 2021Updated 4 years ago
- spring-boot利用scala写spark程序骨架☆28Oct 22, 2019Updated 6 years ago
- MCP = Multiple source Convert Platform☆11Aug 2, 2022Updated 3 years ago
- 基于Flink流处理的动态实时亿级全端用户画像系统可视化界面☆36Dec 9, 2022Updated 3 years ago
- a hyper-optimized single-node(local) version of spark sql engine, which's fundamental data structure is scala Iterator rather than RDD.☆13Jun 13, 2023Updated 2 years ago
- SparkListener that converts SparkListenerEvents to JSON and forwards them to an external service via RPC.☆17Apr 6, 2021Updated 5 years ago
- My branch of Apache Flume with a generic JDBC sink (not yet licensed to Apache)☆11Feb 12, 2022Updated 4 years ago
- 一个基于ElasticSearch的业务日志记录工具☆10Nov 5, 2018Updated 7 years ago
- 基于TBSchedule开发的一个分布式任务调度框架，可以解析任务间的依赖，并执行任务（执行Shell、bat脚本）☆12Aug 5, 2016Updated 9 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- awesome-scalability 的中文翻译☆15Feb 10, 2022Updated 4 years ago
- 双端trie树的python实现☆11Jul 23, 2018Updated 7 years ago
- A simple shell envrioment to acces k8s resources☆11Nov 5, 2017Updated 8 years ago
- 思维导图分享☆12May 5, 2019Updated 7 years ago
- 微服务架构实战篇（五）：Spring boot2.x + Guava 并使用RateLimiter秒杀限流☆12Mar 14, 2019Updated 7 years ago
- Network visualization with Gephi: tutorial and example data files☆16Jan 4, 2017Updated 9 years ago
- Vertica Hadoop Connector☆38Mar 31, 2015Updated 11 years ago
- ☆15Aug 25, 2014Updated 11 years ago
- 使用springboot+mybatis后台框架 前端bootstrap框架 添加web socket实时提醒订单消息 使用springsecurity进行权限拦截 邮箱+短信验证 ，echart图表显示用户订单信息，poi表报打印等等。。。☆12Oct 25, 2017Updated 8 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 使用shell脚本部署Apache Doris (incubating) FE & BE☆11Jul 8, 2019Updated 6 years ago
- 批量处理小工具：①批量将word文档转换为pdf②给pdf文档批量添加水印☆12May 11, 2022Updated 3 years ago
- A logstash codec plugin for decoding and encoding Avro records☆15Nov 26, 2025Updated 5 months ago
- 在线编辑pdf文档☆11Jun 21, 2022Updated 3 years ago
- ☆10Updated this week
- 本工程主要解决在IOS内加载3D模型的问题☆11Mar 9, 2015Updated 11 years ago
- Nodejs Rule Engine☆12Dec 10, 2018Updated 7 years ago