手动管理spark streaming集成kafka的数据偏移量到zookeeper中
☆21Jul 6, 2018Updated 8 years ago
Alternatives and similar repositories for sparkStreaming-offset-to-zk
Users that are interested in sparkStreaming-offset-to-zk are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失☆43Aug 2, 2017Updated 9 years ago
- Code for processing AVRO data in Spark Streaming + Kafka (DirectKafka approach with custom offset management in zookeeper)☆29Sep 9, 2016Updated 10 years ago
- 一个手动管理spark streaming集成kafka时的偏移量到zookeeper中的小项目☆132Dec 17, 2025Updated 11 months ago
- 此工程采用SpringBoot + Mybatis + SparkSQL + Hive框架进行集成,支持Kerberos认证。☆21Mar 19, 2018Updated 8 years ago
- SparkSQL数据分析案例☆24Dec 3, 2016Updated 9 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 封装sparkstreaming动态调节batch time(有数据就执行计算); 支持运行过程中增删topic; 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。☆181Apr 15, 2021Updated 5 years ago
- spark实例代码☆78Nov 11, 2017Updated 9 years ago
- spark将hdfs数据高性能灌入kafka,然后spark streaming/structured streaming高速消费,关注性能,欢迎提供性能/代码优化建议☆32Mar 24, 2019Updated 7 years ago
- 简单易用的ETL工具☆17Mar 28, 2019Updated 7 years ago
- spark学习中文笔记☆12Mar 26, 2019Updated 7 years ago
- 一个统一入口、减少对接成本、同时兼顾多种短信业务、简单易行的操作与维护、高稳定、高可靠的短信平台。通过智能动态的通道评级、选举、降级、热插拔,增强了系统的健壮性,摆脱对单一通道的依赖。并且提供多种对接方式的短信发送和管理平台☆12Jan 5, 2023Updated 3 years ago
- Spark Streaming监控平台,支持任务部署与告警、自启动☆129Mar 29, 2018Updated 8 years ago
- 基于Flink流处理的动态实时亿级全端用户画像系统可视化界面☆35Dec 9, 2022Updated 3 years ago
- spring-boot利用scala写spark程序骨架☆28Oct 22, 2019Updated 7 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- a hyper-optimized single-node(local) version of spark sql engine, which's fundamental data structure is scala Iterator rather than RDD.☆13Jun 13, 2023Updated 3 years ago
- 一个基于ElasticSearch的业务日志记录工具☆10Nov 5, 2018Updated 8 years ago
- MCP = Multiple source Convert Platform☆10Aug 2, 2022Updated 4 years ago
- 基于TBSchedule开发的一个分布式任务调度框架,可以解析任务间的依赖,并执行任务(执行Shell、bat脚本)☆12Aug 5, 2016Updated 10 years ago
- SparkListener that converts SparkListenerEvents to JSON and forwards them to an external service via RPC.☆16Apr 6, 2021Updated 5 years ago
- A shell script to automate the operations of sqoop☆11Mar 29, 2021Updated 5 years ago
- 用户画像代码,根据算法推算出用户的性别和年龄比率☆11Dec 18, 2017Updated 8 years ago
- 使用SpringBoot开发的基于HBASE的大数据存储分布式云计算笔记(后端)☆32Mar 30, 2019Updated 7 years ago
- 基于springbook+spark的机器学习应用开发☆12Nov 21, 2022Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Nodejs Rule Engine☆12Dec 10, 2018Updated 7 years ago
- My branch of Apache Flume with a generic JDBC sink (not yet licensed to Apache)☆11Feb 12, 2022Updated 4 years ago
- scala结合actor编写的分布式网络爬虫☆15Oct 11, 2016Updated 10 years ago
- The world beyond batch: Streaming 102中文翻译☆16Mar 17, 2017Updated 9 years ago
- CDAP Cube Dataset Guide☆11Aug 26, 2017Updated 9 years ago
- springmvc+phoenix操作hbase的web架构☆10Aug 20, 2018Updated 8 years ago
- 使用springboot+mybatis后台框架 前端bootstrap框架 添加web socket实时提醒订单消息 使用springsecurity进行权限拦截 邮箱+短信验证 ,echart图表显示用户订单信息,poi表报打印等等。。。☆12Oct 25, 2017Updated 9 years ago
- 使用shell脚本部署Apache Doris (incubating) FE & BE☆11Jul 8, 2019Updated 7 years ago
- 近实时计算, kafka, spark-stream, spark-sql, redis rua☆11Mar 17, 2018Updated 8 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- POC for all the stack of big data (kafka, spark, cassandra, hdfs, docker, springboot)☆12Dec 16, 2022Updated 3 years ago
- 华为软件精英挑战赛2019,实时计算全图路况,每辆车在每个时刻(或隔几个时刻)根据自身信息生成自己的权重矩阵,利用SPFA算法动态规划路径☆10Apr 14, 2019Updated 7 years ago
- 在线编辑pdf文档☆11Jun 21, 2022Updated 4 years ago
- 双端trie树的python实现☆11Jul 23, 2018Updated 8 years ago
- Data Browser for PostgreSQL☆19Feb 13, 2017Updated 9 years ago
- 元数据管理系统☆17Jan 20, 2018Updated 8 years ago
- A simple shell envrioment to acces k8s resources☆11Nov 5, 2017Updated 9 years ago
Are these results useful?