cpbaranwal/Spark-Streaming-DirectKafka-Examples external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

cpbaranwal/Spark-Streaming-DirectKafka-Examples

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/cpbaranwal/Spark-Streaming-DirectKafka-Examples)

Close

cpbaranwal / Spark-Streaming-DirectKafka-ExamplesView on GitHubMore

• External links
• Readme badge

DirectKafka examples for Spark Streaming : 1. with checkpointing 2. Custom offset management

☆59Sep 9, 2016Updated 9 years ago

Alternatives and similar repositories for Spark-Streaming-DirectKafka-Examples

Users that are interested in Spark-Streaming-DirectKafka-Examples are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• E-SoulDataGroup / spark_streaming_kafka_offset

  View on GitHub
  SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失
  ☆43Aug 2, 2017Updated 9 years ago
• cpbaranwal / Avro-SparkStreaming-Kafka

  View on GitHub
  Code for processing AVRO data in Spark Streaming + Kafka (DirectKafka approach with custom offset management in zookeeper)
  ☆29Sep 9, 2016Updated 9 years ago
• koeninger / kafka-exactly-once

  View on GitHub
  ☆241Jun 14, 2018Updated 8 years ago
• tresata / spark-kafka

  View on GitHub
  Low level integration of Spark and Kafka
  ☆129Mar 15, 2018Updated 8 years ago
• chimpler / blog-spark-streaming-log-aggregation

  View on GitHub
  Example of use of Spark Streaming with Kafka
  ☆89Jul 11, 2014Updated 12 years ago
• Wordpress hosting with auto-scaling - Free Trial Offer • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• spirom / spark-streaming-with-kafka

  View on GitHub
  Self-contained examples of Apache Spark streaming integrated with Apache Kafka.
  ☆196Apr 15, 2018Updated 8 years ago
• ippontech / spark-kafka-source

  View on GitHub
  Kafka stream for Spark with storage of the offsets in ZooKeeper
  ☆60Apr 18, 2017Updated 9 years ago
• gdtm86 / spark-streaming-kafka-cdh511-testing

  View on GitHub
  Spark Streaming,Kafka and HBase code accompanying the blog 'Offset Management For Apache Kafka With Apache Spark Streaming'
  ☆23Jun 26, 2017Updated 9 years ago
• qindongliang / streaming-offset-to-zk

  View on GitHub
  一个手动管理spark streaming集成kafka时的偏移量到zookeeper中的小项目
  ☆132Dec 17, 2025Updated 7 months ago
• yamrcraft / etl-light

  View on GitHub
  A light Kafka to HDFS/S3 ETL library based on Apache Spark
  ☆40Jun 29, 2017Updated 9 years ago
• xlturing / spark-journey

  View on GitHub
  spark实例代码
  ☆78Nov 11, 2017Updated 8 years ago
• wangliangbd / SparkStreaming_Store_KafkaTopicOffset_To_HBase

  View on GitHub
  Kafka delivery semantics in the case of failure depend on how and when offsets are stored. Spark output operations are at-least-once. So …
  ☆38Apr 19, 2017Updated 9 years ago
• allwefantasy / spark-binlog

  View on GitHub
  A library for querying Binlog with Apache Spark structure streaming, for Spark SQL , DataFrames and [MLSQL](https://www.mlsql.tech).
  ☆152Apr 21, 2023Updated 3 years ago
• jerryshao / spark-hive-streaming-sink

  View on GitHub
  A sink to save Spark Structured Streaming DataFrame into Hive table
  ☆29Apr 16, 2018Updated 8 years ago
• Managed Database hosting by DigitalOcean • Ad
  PostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
• onefoursix / Cloudera-Impala-JDBC-Example

  View on GitHub
  A Maven-based example of using Cloudera Impala's JDBC driver
  ☆118May 10, 2016Updated 10 years ago
• flowers2023 / spark-streaming

  View on GitHub
  spark流数据处理，可以从flume-ng，kafka接收数据
  ☆11Sep 16, 2015Updated 10 years ago
• dantezhao / data-group

  View on GitHub
  ☆76Oct 22, 2018Updated 7 years ago
• justinrmiller / spark-kafka-parquet-example

  View on GitHub
  An example project that combines Spark Streaming, Kafka, and Parquet to transform JSON objects streamed over Kafka into Parquet files in …
  ☆19Jun 22, 2021Updated 5 years ago
• WeichenXu123 / spark-ml-source-analysis

  View on GitHub
  spark ml 算法原理剖析以及具体的源码实现分析
  ☆10Jan 25, 2017Updated 9 years ago
• cjuexuan / mynote

  View on GitHub
  ☆232Sep 15, 2022Updated 3 years ago
• zhangjr-gaoyou / spring-boot-spark-demo

  View on GitHub
  使用spring-boot-spark的一个样例
  ☆11Aug 3, 2018Updated 8 years ago
• fayson / cdhproject

  View on GitHub
  hadoop各组件使用，持续更新
  ☆896Jan 4, 2023Updated 3 years ago
• DinoZhang / flink-connector-redis

  View on GitHub
  flink sql redis 连接器
  ☆12Nov 20, 2023Updated 2 years ago
• Deploy on Railway without the complexity - Free Credits Offer • Ad
  Connect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
• teamsoo / elasticsearch-ambari

  View on GitHub
  Elasticsearch Service for Ambari
  ☆14Feb 16, 2018Updated 8 years ago
• EdwardsBean / flume-spark-streaming

  View on GitHub
  conbine flume,spark-streaming and redis for real-time computing
  ☆22Oct 20, 2014Updated 11 years ago
• weibin0516 / spark-sourcecodes-analysis

  View on GitHub
  Spark源码剖析
  ☆86Nov 23, 2017Updated 8 years ago
• qiref / hbase-component

  View on GitHub
  利用SpringBoot整合HBase，基于HBaseJavaAPI的二次封装，可以直接引用jar包使用，目前测试已支持HBase1.1.2和HBase1.4.6以及HBase2.0.2三个版本。
  ☆15Sep 25, 2024Updated last year
• gudaoxuri / ez-fs

  View on GitHub
  实现Local、FTP、HDFS文件系统的统一操作。
  ☆13May 12, 2016Updated 10 years ago
• ken-hu / hui-bigdata-spark

  View on GitHub
  【bigdata】spirngboot+spark 脚手架+相关实例
  ☆22Jun 21, 2022Updated 4 years ago
• caroljmcdonald / mapr-streams-sparkstreaming-hbase

  View on GitHub
  ☆24Apr 29, 2016Updated 10 years ago
• LeechanX / Netflix-Recommender-with-Spark

  View on GitHub
  基于Apache Spark的Netflix电影的离线与实时推荐系统
  ☆250Mar 21, 2017Updated 9 years ago
• wypb / spark-summit-2017-Europe

  View on GitHub
  Spark summit 2017 europe ppt下载
  ☆43Nov 2, 2017Updated 8 years ago
• Deploy on Railway without the complexity - Free Credits Offer • Ad
  Connect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
• jacksu / utils4s

  View on GitHub
  scala、spark使用过程中，各种测试用例以及相关资料整理
  ☆1,079Feb 9, 2019Updated 7 years ago
• xuanzhao / imooc_spark_log_analysis

  View on GitHub
  以慕课网日志分析为例 进入大数据 Spark SQL 的世界
  ☆15Apr 3, 2018Updated 8 years ago
• leoChaoGlut / presto-research

  View on GitHub
  presto 源码分析
  ☆50Feb 2, 2018Updated 8 years ago
• anowls / spring-hadoop

  View on GitHub
  大数据实习hdfs+flume+kafka+spark+hbase+hive项目
  ☆35Jul 25, 2017Updated 9 years ago
• 2gis / kafka-connect-hdfs-ext

  View on GitHub
  Set of extensions for kafka connect hdfs
  ☆11May 12, 2021Updated 5 years ago
• Haricharanpanjwani / Application_Engineering_Design

  View on GitHub
  Projects based on IoT, Healthcare and Disaster Management
  ☆12May 2, 2016Updated 10 years ago
• bluebreezecf / SparkJobServerClient

  View on GitHub
  Java Client of the Spark Job Server implementing the arranged Rest APIs
  ☆52Jun 4, 2021Updated 5 years ago