wangfengchao / sparkStreaming-offset-to-zk

Related projects ⓘ

Alternatives and complementary repositories for sparkStreaming-offset-to-zk

• YunKillerE / sparkStreamingKafkaPerformance
  spark将hdfs数据高性能灌入kafka，然后spark streaming/structured streaming高速消费，关注性能，欢迎提供性能/代码优化建议
  ☆33Updated 5 years ago
• E-SoulDataGroup / spark_streaming_kafka_offset
  SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失
  ☆45Updated 7 years ago
• xinghalo / Teddy
  Spark Streaming监控平台，支持任务部署与告警、自启动
  ☆128Updated 6 years ago
• teeyog / blog
  My Blog
  ☆76Updated 6 years ago
• qindongliang / streaming-offset-to-zk
  一个手动管理spark streaming集成kafka时的偏移量到zookeeper中的小项目
  ☆136Updated 3 months ago
• xlturing / spark-journey
  spark实例代码
  ☆78Updated 7 years ago
• GuoNingNing / fire-spark
  Spark 脚手架工程，标准化 spark 开发、部署、测试流程。
  ☆93Updated last month
• peopleindreamdontsleep / StructuredStreamingInSQL
  sql实现Structured Streaming
  ☆39Updated 5 years ago
• LinMingQiang / sparkstreaming
  封装sparkstreaming动态调节batch time(有数据就执行计算)； 支持运行过程中增删topic； 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。
  ☆182Updated 3 years ago
• duhanmin / structured-streaming-Kafka2HBase
  Spark structured-streaming 消费kafka数据写入hbase
  ☆33Updated 5 years ago
• kingekinge / spark-submit-ui
  This is a based on playframwork for submit spark app
  ☆60Updated last year
• opensourceteams / flink-maven-scala
  flink技术学习笔记分享
  ☆83Updated 5 years ago
• opensourceteams / spark-scala-maven
  spark-scala-maven
  ☆58Updated 5 years ago
• cpbaranwal / Spark-Streaming-DirectKafka-Examples
  DirectKafka examples for Spark Streaming : 1. with checkpointing 2. Custom offset management
  ☆61Updated 8 years ago
• wangliangbd / SparkStreaming_Store_KafkaTopicOffset_To_HBase
  Kafka delivery semantics in the case of failure depend on how and when offsets are stored. Spark output operations are at-least-once. So …
  ☆37Updated 7 years ago
• guofei1219 / SparkSQL
  SparkSQL数据分析案例
  ☆23Updated 7 years ago
• lttoto / SparkStreamingProject
  SparkStreaming项目，显示flume->Kafka->Spark->hbase(实时数据处理方案)，Scala实现
  ☆35Updated 6 years ago
• tophua / spark1.52
  Spark源代码中文注释
  ☆42Updated 6 years ago
• winstonelei / BigDataTools
  tools for bigData
  ☆37Updated 5 years ago
• LinMingQiang / spark-utils
  Encapsulated spark 与其他组件的结合api，方便使用，例如 es，hbase，kudu，kafka，mq等
  ☆35Updated 4 years ago
• linyiqun / yarn-jobhistory-crawler
  JobHistory上的job信息爬取工具
  ☆34Updated 9 years ago
• xiaohei-info / Spark_DB_Connector
  Use Scala API to read/write data from different databases,HBase,MySQL,etc.
  ☆24Updated 6 years ago
• ruozedata / BigData
  ☆151Updated 3 years ago
• streaming-olap / training
  ☆53Updated 6 years ago
• wanghan0501 / UserSessionBehaviorOfflineAnalysis
  四川大学拓思爱诺用户session行为数据离线分析项目
  ☆67Updated 2 years ago
• fayson / cdh-autouninstall
  基于CDH5.x parcles安装，一键卸载脚本
  ☆38Updated 2 years ago
• weibin0516 / spark-sourcecodes-analysis
  Spark源码剖析
  ☆87Updated 6 years ago
• gdtm86 / spark-streaming-kafka-cdh511-testing
  Spark Streaming,Kafka and HBase code accompanying the blog 'Offset Management For Apache Kafka With Apache Spark Streaming'
  ☆23Updated 7 years ago
• pdaodao / fiflow
  flink-sql 在 flink 上运行 sql 和 构建数据流的平台 基于 apache flink 1.10.0
  ☆112Updated 2 years ago