wangliangbd/SparkStreaming_Store_KafkaTopicOffset_To_HBase external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

wangliangbd/SparkStreaming_Store_KafkaTopicOffset_To_HBase

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/wangliangbd/SparkStreaming_Store_KafkaTopicOffset_To_HBase)

Close

wangliangbd / SparkStreaming_Store_KafkaTopicOffset_To_HBaseView on GitHubMore

• External links
• Readme badge

Kafka delivery semantics in the case of failure depend on how and when offsets are stored. Spark output operations are at-least-once. So if you want the equivalent of exactly-once semantics, you must either store offsets after an idempotent output, or store offsets in an atomic transaction alongside output.There is Spark Streaming how to store K…

☆37Apr 19, 2017Updated 8 years ago

Alternatives and similar repositories for SparkStreaming_Store_KafkaTopicOffset_To_HBase

Users that are interested in SparkStreaming_Store_KafkaTopicOffset_To_HBase are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• TopSpoofer / kafka-spark-streaming-to-hbase

  View on GitHub
  使用spark streaming 导入kafka数据到hbase
  ☆25Apr 14, 2016Updated 9 years ago
• E-SoulDataGroup / spark_streaming_kafka_offset

  View on GitHub
  SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失
  ☆44Aug 2, 2017Updated 8 years ago
• smartxing / calcite

  View on GitHub
  sql 解析引擎 探索
  ☆16Dec 29, 2017Updated 8 years ago
• nagendra-avr / kafka-sparkstreaming-hbase

  View on GitHub
  ☆12May 11, 2016Updated 9 years ago
• Gschiavon / Kafka-SparkStreaming-HDFS

  View on GitHub
  ☆14Nov 3, 2016Updated 9 years ago
• End-to-end encrypted cloud storage - Proton Drive • Ad
  Special offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
• allwefantasy / spark-hbase

  View on GitHub
  A HBase datasource implementation for Spark and [MLSQL](http://www.mlsql.tech).
  ☆15Sep 29, 2023Updated 2 years ago
• dafei1288 / CalciteDocTrans

  View on GitHub
  翻译Calcite文档，非官方
  ☆15Jul 24, 2019Updated 6 years ago
• a123demi / spring-sparkstreaming-kafka-10

  View on GitHub
  spring+spark streaming+kafka 10版本集成和异常问题处理
  ☆17Jul 21, 2017Updated 8 years ago
• leno1001 / spark_monitor

  View on GitHub
  请求spark rest API获取applications，jobs，stages，executors，rdds，streaming，environment等信息提供监控和报警服务
  ☆11Nov 22, 2018Updated 7 years ago
• semantalytics / awesome-druid

  View on GitHub
  ☆62May 29, 2019Updated 6 years ago
• opensourceteams / spark-scala-maven

  View on GitHub
  spark-scala-maven
  ☆58Dec 18, 2018Updated 7 years ago
• mbalassi / flink-parcel

  View on GitHub
  Flink parcel for Cloudera Manager
  ☆22Aug 1, 2019Updated 6 years ago
• LinMingQiang / sparkstreaming

  View on GitHub
  封装sparkstreaming动态调节batch time(有数据就执行计算)； 支持运行过程中增删topic； 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。
  ☆181Apr 15, 2021Updated 4 years ago
• justinrmiller / spark-kafka-parquet-example

  View on GitHub
  An example project that combines Spark Streaming, Kafka, and Parquet to transform JSON objects streamed over Kafka into Parquet files in …
  ☆19Jun 22, 2021Updated 4 years ago
• DigitalOcean Gradient AI Platform • Ad
  Build production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
• fansy1990 / javaweb_spark_standalone_monitor

  View on GitHub
  ☆14Apr 12, 2022Updated 3 years ago
• cjuexuan / mynote

  View on GitHub
  ☆235Sep 15, 2022Updated 3 years ago
• caroljmcdonald / SparkStreamingHBaseExample

  View on GitHub
  Spark Streaming HBase Example
  ☆94Apr 4, 2016Updated 10 years ago
• stdatalabs / aadhaar-dataset-analysis

  View on GitHub
  An analysis on Aadhaar dataset using Mapreduce and Spark
  ☆14Feb 28, 2018Updated 8 years ago
• qindongliang / streaming-offset-to-zk

  View on GitHub
  一个手动管理spark streaming集成kafka时的偏移量到zookeeper中的小项目
  ☆133Dec 17, 2025Updated 3 months ago
• milinda / calcite-tutorial

  View on GitHub
  Apache Calcite Tutorial
  ☆33Jun 24, 2016Updated 9 years ago
• duhanmin / structured-streaming-Kafka2HBase

  View on GitHub
  Spark structured-streaming 消费kafka数据写入hbase
  ☆33Jan 22, 2019Updated 7 years ago
• zqhxuyuan / kafka-book

  View on GitHub
  《Kafka技术内幕》代码
  ☆190Dec 19, 2017Updated 8 years ago
• LinMingQiang / spark-utils

  View on GitHub
  Encapsulated spark 与其他组件的结合api，方便使用，例如 es，hbase，kudu，kafka，mq等
  ☆35Dec 18, 2019Updated 6 years ago
• Proton VPN Special Offer - Get 70% off • Ad
  Special partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
• teeyog / IQL

  View on GitHub
  An ad hoc query service based on the spark sql engine.(基于spark sql引擎的即席查询服务)
  ☆380Dec 16, 2023Updated 2 years ago
• zhanyingf15 / elasticsearch-jdbc

  View on GitHub
  elasticsearch-jdbc，在elasticsearch-sql的jdbc实验特性基础上完成，可使用sql和rest api的方式执行elasticsearch操作
  ☆18Mar 8, 2019Updated 7 years ago
• cpbaranwal / Spark-Streaming-DirectKafka-Examples

  View on GitHub
  DirectKafka examples for Spark Streaming : 1. with checkpointing 2. Custom offset management
  ☆60Sep 9, 2016Updated 9 years ago
• allwefantasy / spark-binlog

  View on GitHub
  A library for querying Binlog with Apache Spark structure streaming, for Spark SQL , DataFrames and [MLSQL](https://www.mlsql.tech).
  ☆153Apr 21, 2023Updated 2 years ago
• flowers2023 / spark-streaming

  View on GitHub
  spark流数据处理，可以从flume-ng，kafka接收数据
  ☆11Sep 16, 2015Updated 10 years ago
• passionke / starry

  View on GitHub
  fast spark local mode
  ☆35Aug 20, 2018Updated 7 years ago
• DmitryBe / clickhouse-kafka-connect

  View on GitHub
  Ingress data from kafka topic into clickhouse table (JSON format)
  ☆24Apr 12, 2018Updated 7 years ago
• xubo245 / CarbonDataLearning

  View on GitHub
  Apache CarbonData Learning
  ☆53Mar 5, 2020Updated 6 years ago
• TimeIvyace / OpenCV-PCA-KNN-SVM_face_recognition

  View on GitHub
  Using OpenCV+PCA+KNN/SVM to implement face detection and recognition
  ☆12Mar 18, 2018Updated 8 years ago
• NordVPN Special Discount Offer • Ad
  Save on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
• caroljmcdonald / mapr-streams-sparkstreaming-hbase

  View on GitHub
  ☆24Apr 29, 2016Updated 9 years ago
• hey-johnnypark / apache-flink-jdbc-streaming

  View on GitHub
  Sample project for Apache Flink with Streaming Engine and JDBC Sink
  ☆21Apr 1, 2017Updated 9 years ago
• Hackeruncle / MySQL

  View on GitHub
  MySQL Product Maintenance
  ☆43Dec 30, 2019Updated 6 years ago
• TopSpoofer / hbrdd

  View on GitHub
  一个为spark批量导入数据到hbase的库
  ☆43Nov 18, 2016Updated 9 years ago
• JunjianS / spark-streaming-kafka-demo

  View on GitHub
  spark streaming从kafka读取消息，offset写入Redis，spark计算单词出现频率，最后写入hive表
  ☆17Jul 30, 2019Updated 6 years ago
• 597365581 / bigdata_tools

  View on GitHub
  bigdata_tools
  ☆29Mar 27, 2023Updated 3 years ago
• zhang637 / kafka_spark_hbase_demo

  View on GitHub
  kafka spark hbase 日志统计
  ☆82Dec 23, 2016Updated 9 years ago