wangliangbd/SparkStreaming_Store_KafkaTopicOffset_To_HBase external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

wangliangbd/SparkStreaming_Store_KafkaTopicOffset_To_HBase

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/wangliangbd/SparkStreaming_Store_KafkaTopicOffset_To_HBase)

Close

wangliangbd / SparkStreaming_Store_KafkaTopicOffset_To_HBaseView on GitHubMore

• External links
• Readme badge

Kafka delivery semantics in the case of failure depend on how and when offsets are stored. Spark output operations are at-least-once. So if you want the equivalent of exactly-once semantics, you must either store offsets after an idempotent output, or store offsets in an atomic transaction alongside output.There is Spark Streaming how to store K…

☆38Apr 19, 2017Updated 9 years ago

Alternatives and similar repositories for SparkStreaming_Store_KafkaTopicOffset_To_HBase

Users that are interested in SparkStreaming_Store_KafkaTopicOffset_To_HBase are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• TopSpoofer / kafka-spark-streaming-to-hbase

  View on GitHub
  使用spark streaming 导入kafka数据到hbase
  ☆25Apr 14, 2016Updated 10 years ago
• E-SoulDataGroup / spark_streaming_kafka_offset

  View on GitHub
  SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失
  ☆43Aug 2, 2017Updated 9 years ago
• smartxing / calcite

  View on GitHub
  sql 解析引擎 探索
  ☆16Dec 29, 2017Updated 8 years ago
• nagendra-avr / kafka-sparkstreaming-hbase

  View on GitHub
  ☆12May 11, 2016Updated 10 years ago
• Gschiavon / Kafka-SparkStreaming-HDFS

  View on GitHub
  ☆14Nov 3, 2016Updated 9 years ago
• Wordpress hosting with auto-scaling - Free Trial Offer • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• mapr-demos / SparkStreamingHBaseExample

  View on GitHub
  Spark Streaming HBase Example
  ☆22May 20, 2026Updated 3 months ago
• allwefantasy / spark-hbase

  View on GitHub
  A HBase datasource implementation for Spark and [MLSQL](http://www.mlsql.tech).
  ☆15Sep 29, 2023Updated 2 years ago
• dafei1288 / CalciteDocTrans

  View on GitHub
  翻译Calcite文档，非官方
  ☆15Jul 24, 2019Updated 7 years ago
• a123demi / spring-sparkstreaming-kafka-10

  View on GitHub
  spring+spark streaming+kafka 10版本集成和异常问题处理
  ☆17Jul 21, 2017Updated 9 years ago
• leno1001 / spark_monitor

  View on GitHub
  请求spark rest API获取applications，jobs，stages，executors，rdds，streaming，environment等信息提供监控和报警服务
  ☆11Nov 22, 2018Updated 7 years ago
• opensourceteams / spark-scala-maven

  View on GitHub
  spark-scala-maven
  ☆58Dec 18, 2018Updated 7 years ago
• mbalassi / flink-parcel

  View on GitHub
  Flink parcel for Cloudera Manager
  ☆22Aug 1, 2019Updated 7 years ago
• justinrmiller / spark-kafka-parquet-example

  View on GitHub
  An example project that combines Spark Streaming, Kafka, and Parquet to transform JSON objects streamed over Kafka into Parquet files in …
  ☆19Jun 22, 2021Updated 5 years ago
• Neuw84 / structured-streaming-avro-demo

  View on GitHub
  Spark 3.0.0 Structured Streaming Kafka Avro Demo
  ☆15Apr 21, 2023Updated 3 years ago
• Deploy on Railway without the complexity - Free Credits Offer • Ad
  Connect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
• cjuexuan / mynote

  View on GitHub
  ☆232Sep 15, 2022Updated 4 years ago
• fansy1990 / javaweb_spark_standalone_monitor

  View on GitHub
  ☆14Apr 12, 2022Updated 4 years ago
• caroljmcdonald / SparkStreamingHBaseExample

  View on GitHub
  Spark Streaming HBase Example
  ☆93Apr 4, 2016Updated 10 years ago
• stdatalabs / aadhaar-dataset-analysis

  View on GitHub
  An analysis on Aadhaar dataset using Mapreduce and Spark
  ☆14Feb 28, 2018Updated 8 years ago
• qindongliang / streaming-offset-to-zk

  View on GitHub
  一个手动管理spark streaming集成kafka时的偏移量到zookeeper中的小项目
  ☆132Dec 17, 2025Updated 9 months ago
• joeseesun / qiaomu-hn-reader

  View on GitHub
  中文 Hacker News 速读：缓存、翻译并总结热门讨论 | Chinese-first HN reader with cached translations and discussion summaries.
  ☆18Jul 11, 2026Updated 2 months ago
• milinda / calcite-tutorial

  View on GitHub
  Apache Calcite Tutorial
  ☆33Jun 24, 2016Updated 10 years ago
• duhanmin / structured-streaming-Kafka2HBase

  View on GitHub
  Spark structured-streaming 消费kafka数据写入hbase
  ☆33Jan 22, 2019Updated 7 years ago
• zqhxuyuan / kafka-book

  View on GitHub
  《Kafka技术内幕》代码
  ☆190Dec 19, 2017Updated 8 years ago
• Simple, predictable pricing with DigitalOcean hosting • Ad
  Always know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
• LinMingQiang / spark-utils

  View on GitHub
  Encapsulated spark 与其他组件的结合api，方便使用，例如 es，hbase，kudu，kafka，mq等
  ☆36Dec 18, 2019Updated 6 years ago
• teeyog / IQL

  View on GitHub
  An ad hoc query service based on the spark sql engine.(基于spark sql引擎的即席查询服务)
  ☆376Dec 16, 2023Updated 2 years ago
• zhanyingf15 / elasticsearch-jdbc

  View on GitHub
  elasticsearch-jdbc，在elasticsearch-sql的jdbc实验特性基础上完成，可使用sql和rest api的方式执行elasticsearch操作
  ☆18Mar 8, 2019Updated 7 years ago
• TimeIvyace / OpenCV-PCA-KNN-SVM_face_recognition

  View on GitHub
  Using OpenCV+PCA+KNN/SVM to implement face detection and recognition
  ☆12Mar 18, 2018Updated 8 years ago
• DmitryBe / clickhouse-kafka-connect

  View on GitHub
  Ingress data from kafka topic into clickhouse table (JSON format)
  ☆24Apr 12, 2018Updated 8 years ago
• flowers2023 / spark-streaming

  View on GitHub
  spark流数据处理，可以从flume-ng，kafka接收数据
  ☆11Sep 16, 2015Updated 11 years ago
• passionke / starry

  View on GitHub
  fast spark local mode
  ☆35Aug 20, 2018Updated 8 years ago
• TopSpoofer / hbrdd

  View on GitHub
  一个为spark批量导入数据到hbase的库
  ☆43Nov 18, 2016Updated 9 years ago
• caroljmcdonald / mapr-streams-sparkstreaming-hbase

  View on GitHub
  ☆24Apr 29, 2016Updated 10 years ago
• AI Agents on DigitalOcean Gradient AI Platform • Ad
  Build production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
• xubo245 / CarbonDataLearning

  View on GitHub
  Apache CarbonData Learning
  ☆53Mar 5, 2020Updated 6 years ago
• Hackeruncle / MySQL

  View on GitHub
  MySQL Product Maintenance
  ☆43Dec 30, 2019Updated 6 years ago
• hey-johnnypark / apache-flink-jdbc-streaming

  View on GitHub
  Sample project for Apache Flink with Streaming Engine and JDBC Sink
  ☆21Apr 1, 2017Updated 9 years ago
• Puyodead1 / udemy-dl-go

  View on GitHub
  A WIP Udemy downloader written in Go
  ☆11Mar 20, 2022Updated 4 years ago
• master-cloner / cornerstone

  View on GitHub
  Crawl the same/asynchronous rendering of web pages for localized resource storage
  ☆13Jul 18, 2026Updated 2 months ago
• antonrud / flink-kafka-influx-grafana-framework

  View on GitHub
  This application is an example of basic Flink-Kafka-InfluxDB workflow
  ☆13Jul 16, 2018Updated 8 years ago
• cpbaranwal / Avro-SparkStreaming-Kafka

  View on GitHub
  Code for processing AVRO data in Spark Streaming + Kafka (DirectKafka approach with custom offset management in zookeeper)
  ☆29Sep 9, 2016Updated 10 years ago