手动管理spark streaming集成kafka的数据偏移量到zookeeper中
☆21Jul 6, 2018Updated 8 years ago
Alternatives and similar repositories for sparkStreaming-offset-to-zk
Users that are interested in sparkStreaming-offset-to-zk are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 请求spark rest API获取applications，jobs，stages，executors，rdds，streaming，environment等信息提供监控和报警服务☆11Nov 22, 2018Updated 7 years ago
- SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失☆43Aug 2, 2017Updated 9 years ago
- Code for processing AVRO data in Spark Streaming + Kafka (DirectKafka approach with custom offset management in zookeeper)☆29Sep 9, 2016Updated 10 years ago
- hive sql parser☆11Aug 27, 2014Updated 12 years ago
- 一个手动管理spark streaming集成kafka时的偏移量到zookeeper中的小项目☆132Dec 17, 2025Updated 10 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- SparkSQL数据分析案例☆24Dec 3, 2016Updated 9 years ago
- 此工程采用SpringBoot + Mybatis + SparkSQL + Hive框架进行集成，支持Kerberos认证。☆21Mar 19, 2018Updated 8 years ago
- 封装sparkstreaming动态调节batch time(有数据就执行计算)； 支持运行过程中增删topic； 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。☆181Apr 15, 2021Updated 5 years ago
- 简单易用的ETL工具☆17Mar 28, 2019Updated 7 years ago
- spark实例代码☆78Nov 11, 2017Updated 8 years ago
- spark将hdfs数据高性能灌入kafka，然后spark streaming/structured streaming高速消费，关注性能，欢迎提供性能/代码优化建议☆32Mar 24, 2019Updated 7 years ago
- ☆14Apr 20, 2018Updated 8 years ago
- Spark Streaming监控平台，支持任务部署与告警、自启动☆129Mar 29, 2018Updated 8 years ago
- spark学习中文笔记☆12Mar 26, 2019Updated 7 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- fusioninsight_ecosystem☆26May 11, 2022Updated 4 years ago
- 基于Flink流处理的动态实时亿级全端用户画像系统可视化界面☆35Dec 9, 2022Updated 3 years ago
- a hyper-optimized single-node(local) version of spark sql engine, which's fundamental data structure is scala Iterator rather than RDD.☆13Jun 13, 2023Updated 3 years ago
- MCP = Multiple source Convert Platform☆10Aug 2, 2022Updated 4 years ago
- ☆11Oct 30, 2025Updated last year
- 一个基于ElasticSearch的业务日志记录工具☆10Nov 5, 2018Updated 7 years ago
- ☆12Jun 8, 2020Updated 6 years ago
- SparkListener that converts SparkListenerEvents to JSON and forwards them to an external service via RPC.☆16Apr 6, 2021Updated 5 years ago
- A shell script to automate the operations of sqoop☆11Mar 29, 2021Updated 5 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- 用户画像代码，根据算法推算出用户的性别和年龄比率☆11Dec 18, 2017Updated 8 years ago
- A local MCP (Model Context Protocol) server for portable, long-term agentic memory — a thumb drive for your AI context.☆21Aug 31, 2026Updated last month
- No Termux required to use AGENTCODI. No WebView shell. No separate gateway setup. with its own native sandbox in protected mode - With it…☆20Updated this week
- 使用SpringBoot开发的基于HBASE的大数据存储分布式云计算笔记(后端)☆32Mar 30, 2019Updated 7 years ago
- 使用springboot+mybatis后台框架 前端bootstrap框架 添加web socket实时提醒订单消息 使用springsecurity进行权限拦截 邮箱+短信验证 ，echart图表显示用户订单信息，poi表报打印等等。。。☆12Oct 25, 2017Updated 9 years ago
- Generate a production-ready, best-practice Claude Code harness tailored to your use case in minutes -- at any skill level. Or validate, u…☆14Sep 24, 2026Updated last month
- scala结合actor编写的分布式网络爬虫☆15Oct 11, 2016Updated 10 years ago
- echarts大屏展示得数据可视化☆11Sep 6, 2018Updated 8 years ago
- Hadoop exporter☆14Jun 19, 2018Updated 8 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 基于springbook+spark的机器学习应用开发☆12Nov 21, 2022Updated 3 years ago
- My branch of Apache Flume with a generic JDBC sink (not yet licensed to Apache)☆11Feb 12, 2022Updated 4 years ago
- Nodejs Rule Engine☆12Dec 10, 2018Updated 7 years ago
- 有向无环图在大文本匹配N多关键字中的应用☆11Jul 21, 2018Updated 8 years ago
- 批量处理小工具：①批量将word文档转换为pdf②给pdf文档批量添加水印☆13May 11, 2022Updated 4 years ago
- The world beyond batch: Streaming 102中文翻译☆16Mar 17, 2017Updated 9 years ago
- springmvc+phoenix操作hbase的web架构☆10Aug 20, 2018Updated 8 years ago