cpbaranwal / Spark-Streaming-DirectKafka-Examples

Related projects ⓘ

Alternatives and complementary repositories for Spark-Streaming-DirectKafka-Examples

• E-SoulDataGroup / spark_streaming_kafka_offset
  SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失
  ☆45Updated 7 years ago
• xlturing / spark-journey
  spark实例代码
  ☆78Updated 7 years ago
• teeyog / blog
  My Blog
  ☆76Updated 6 years ago
• wangliangbd / SparkStreaming_Store_KafkaTopicOffset_To_HBase
  Kafka delivery semantics in the case of failure depend on how and when offsets are stored. Spark output operations are at-least-once. So …
  ☆37Updated 7 years ago
• peopleindreamdontsleep / StructuredStreamingInSQL
  sql实现Structured Streaming
  ☆39Updated 5 years ago
• caroljmcdonald / SparkStreamingHBaseExample
  Spark Streaming HBase Example
  ☆96Updated 8 years ago
• weibin0516 / spark-sourcecodes-analysis
  Spark源码剖析
  ☆87Updated 6 years ago
• LinMingQiang / sparkstreaming
  封装sparkstreaming动态调节batch time(有数据就执行计算)； 支持运行过程中增删topic； 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。
  ☆182Updated 3 years ago
• kingekinge / spark-submit-ui
  This is a based on playframwork for submit spark app
  ☆60Updated last year
• xinghalo / Teddy
  Spark Streaming监控平台，支持任务部署与告警、自启动
  ☆128Updated 6 years ago
• allwefantasy / spark-binlog
  A library for querying Binlog with Apache Spark structure streaming, for Spark SQL , DataFrames and [MLSQL](https://www.mlsql.tech).
  ☆154Updated last year
• YunKillerE / sparkStreamingKafkaPerformance
  spark将hdfs数据高性能灌入kafka，然后spark streaming/structured streaming高速消费，关注性能，欢迎提供性能/代码优化建议
  ☆33Updated 5 years ago
• opensourceteams / spark-scala-maven
  spark-scala-maven
  ☆58Updated 5 years ago
• GuoNingNing / fire-spark
  Spark 脚手架工程，标准化 spark 开发、部署、测试流程。
  ☆93Updated last month
• rubencasado / Flink-Kudu
  Java library to integrate Flink and Kudu
  ☆54Updated 7 years ago
• TopSpoofer / hbrdd
  一个为spark批量导入数据到hbase的库
  ☆43Updated 8 years ago
• tophua / spark1.52
  Spark源代码中文注释
  ☆42Updated 6 years ago
• wypb / spark-summit-2017-SanFrancisco
  spark summit 2017 SanFrancisco
  ☆97Updated 7 years ago
• gdtm86 / spark-streaming-kafka-cdh511-testing
  Spark Streaming,Kafka and HBase code accompanying the blog 'Offset Management For Apache Kafka With Apache Spark Streaming'
  ☆23Updated 7 years ago
• cjuexuan / mynote
  ☆237Updated 2 years ago
• LinMingQiang / spark-utils
  Encapsulated spark 与其他组件的结合api，方便使用，例如 es，hbase，kudu，kafka，mq等
  ☆35Updated 4 years ago
• jizhang / spark-sandbox
  A playground for Spark jobs.
  ☆44Updated 5 years ago
• alan2lin / hive_ql_parser
  ☆76Updated 11 years ago
• qindongliang / streaming-offset-to-zk
  一个手动管理spark streaming集成kafka时的偏移量到zookeeper中的小项目
  ☆136Updated 3 months ago
• linyiqun / yarn-jobhistory-crawler
  JobHistory上的job信息爬取工具
  ☆34Updated 9 years ago
• mravi / kafka-connect-hbase
  Kafka Connect to Hbase
  ☆43Updated 4 years ago
• marsishandsome / SparkSQL-Internal
  ☆132Updated 5 years ago
• ameyamk / spark-streaming-direct-kafka
  High Performance Spark Streaming with Direct Kafka in Java
  ☆39Updated 8 years ago
• cpbaranwal / Avro-SparkStreaming-Kafka
  Code for processing AVRO data in Spark Streaming + Kafka (DirectKafka approach with custom offset management in zookeeper)
  ☆29Updated 8 years ago