cpbaranwal/Spark-Streaming-DirectKafka-Examples external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

cpbaranwal/Spark-Streaming-DirectKafka-Examples

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/cpbaranwal/Spark-Streaming-DirectKafka-Examples)

Close

cpbaranwal / Spark-Streaming-DirectKafka-ExamplesView on GitHubMore

• External links
• Readme badge

DirectKafka examples for Spark Streaming : 1. with checkpointing 2. Custom offset management

☆59Sep 9, 2016Updated 9 years ago

Alternatives and similar repositories for Spark-Streaming-DirectKafka-Examples

Users that are interested in Spark-Streaming-DirectKafka-Examples are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• Gschiavon / Kafka-SparkStreaming-HDFS

  View on GitHub
  ☆14Nov 3, 2016Updated 9 years ago
• E-SoulDataGroup / spark_streaming_kafka_offset

  View on GitHub
  SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失
  ☆43Aug 2, 2017Updated 8 years ago
• cpbaranwal / Avro-SparkStreaming-Kafka

  View on GitHub
  Code for processing AVRO data in Spark Streaming + Kafka (DirectKafka approach with custom offset management in zookeeper)
  ☆29Sep 9, 2016Updated 9 years ago
• koeninger / kafka-exactly-once

  View on GitHub
  ☆242Jun 14, 2018Updated 8 years ago
• tresata / spark-kafka

  View on GitHub
  Low level integration of Spark and Kafka
  ☆129Mar 15, 2018Updated 8 years ago
• Deploy to Railway using AI coding agents - Free Credits Offer • Ad
  Use Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
• chimpler / blog-spark-streaming-log-aggregation

  View on GitHub
  Example of use of Spark Streaming with Kafka
  ☆89Jul 11, 2014Updated 12 years ago
• spirom / spark-streaming-with-kafka

  View on GitHub
  Self-contained examples of Apache Spark streaming integrated with Apache Kafka.
  ☆196Apr 15, 2018Updated 8 years ago
• ippontech / spark-kafka-source

  View on GitHub
  Kafka stream for Spark with storage of the offsets in ZooKeeper
  ☆60Apr 18, 2017Updated 9 years ago
• gdtm86 / spark-streaming-kafka-cdh511-testing

  View on GitHub
  Spark Streaming,Kafka and HBase code accompanying the blog 'Offset Management For Apache Kafka With Apache Spark Streaming'
  ☆23Jun 26, 2017Updated 9 years ago
• qindongliang / streaming-offset-to-zk

  View on GitHub
  一个手动管理spark streaming集成kafka时的偏移量到zookeeper中的小项目
  ☆133Dec 17, 2025Updated 7 months ago
• yamrcraft / etl-light

  View on GitHub
  A light Kafka to HDFS/S3 ETL library based on Apache Spark
  ☆40Jun 29, 2017Updated 9 years ago
• xlturing / spark-journey

  View on GitHub
  spark实例代码
  ☆78Nov 11, 2017Updated 8 years ago
• mkuthan / example-spark-kafka

  View on GitHub
  Apache Spark and Apache Kafka integration example
  ☆122Dec 21, 2017Updated 8 years ago
• allwefantasy / spark-binlog

  View on GitHub
  A library for querying Binlog with Apache Spark structure streaming, for Spark SQL , DataFrames and [MLSQL](https://www.mlsql.tech).
  ☆152Apr 21, 2023Updated 3 years ago
• 1-Click AI Models by DigitalOcean Gradient • Ad
  Deploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
• jerryshao / spark-hive-streaming-sink

  View on GitHub
  A sink to save Spark Structured Streaming DataFrame into Hive table
  ☆29Apr 16, 2018Updated 8 years ago
• onefoursix / Cloudera-Impala-JDBC-Example

  View on GitHub
  A Maven-based example of using Cloudera Impala's JDBC driver
  ☆118May 10, 2016Updated 10 years ago
• flowers2023 / spark-streaming

  View on GitHub
  spark流数据处理，可以从flume-ng，kafka接收数据
  ☆11Sep 16, 2015Updated 10 years ago
• dantezhao / data-group

  View on GitHub
  ☆76Oct 22, 2018Updated 7 years ago
• justinrmiller / spark-kafka-parquet-example

  View on GitHub
  An example project that combines Spark Streaming, Kafka, and Parquet to transform JSON objects streamed over Kafka into Parquet files in …
  ☆19Jun 22, 2021Updated 5 years ago
• WeichenXu123 / spark-ml-source-analysis

  View on GitHub
  spark ml 算法原理剖析以及具体的源码实现分析
  ☆10Jan 25, 2017Updated 9 years ago
• cjuexuan / mynote

  View on GitHub
  ☆233Sep 15, 2022Updated 3 years ago
• fayson / cdhproject

  View on GitHub
  hadoop各组件使用，持续更新
  ☆897Jan 4, 2023Updated 3 years ago
• BenFradet / spark-kafka-writer

  View on GitHub
  Write your Spark data to Kafka seamlessly
  ☆172Jul 10, 2024Updated 2 years ago
• Bare Metal GPUs on DigitalOcean Gradient AI • Ad
  Purpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
• DinoZhang / flink-connector-redis

  View on GitHub
  flink sql redis 连接器
  ☆12Nov 20, 2023Updated 2 years ago
• jrthe42 / aloha

  View on GitHub
  Aloha: a distributed task scheduling and management framework
  ☆65Dec 6, 2022Updated 3 years ago
• teamsoo / elasticsearch-ambari

  View on GitHub
  Elasticsearch Service for Ambari
  ☆14Feb 16, 2018Updated 8 years ago
• djkdeveloper / xss-filter-spring-boot-starter

  View on GitHub
  springboot auto xss
  ☆11May 23, 2018Updated 8 years ago
• qindongliang / Java-Note

  View on GitHub
  Java相关的笔记
  ☆12Apr 8, 2021Updated 5 years ago
• findify / clickhouse-akka-stream

  View on GitHub
  Clickhouse sink for akka-streams
  ☆15Jan 3, 2022Updated 4 years ago
• EdwardsBean / flume-spark-streaming

  View on GitHub
  conbine flume,spark-streaming and redis for real-time computing
  ☆22Oct 20, 2014Updated 11 years ago
• qiref / hbase-component

  View on GitHub
  利用SpringBoot整合HBase，基于HBaseJavaAPI的二次封装，可以直接引用jar包使用，目前测试已支持HBase1.1.2和HBase1.4.6以及HBase2.0.2三个版本。
  ☆15Sep 25, 2024Updated last year
• gudaoxuri / ez-fs

  View on GitHub
  实现Local、FTP、HDFS文件系统的统一操作。
  ☆13May 12, 2016Updated 10 years ago
• Wordpress hosting with auto-scaling - Free Trial Offer • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• ken-hu / hui-bigdata-spark

  View on GitHub
  【bigdata】spirngboot+spark 脚手架+相关实例
  ☆22Jun 21, 2022Updated 4 years ago
• caroljmcdonald / mapr-streams-sparkstreaming-hbase

  View on GitHub
  ☆24Apr 29, 2016Updated 10 years ago
• wypb / spark-summit-2017-Europe

  View on GitHub
  Spark summit 2017 europe ppt下载
  ☆43Nov 2, 2017Updated 8 years ago
• cas-packone / ambari-impala-service

  View on GitHub
  make Impala on HDP enabled
  ☆51Aug 30, 2019Updated 6 years ago
• anowls / spring-hadoop

  View on GitHub
  大数据实习hdfs+flume+kafka+spark+hbase+hive项目
  ☆35Jul 25, 2017Updated 9 years ago
• 2gis / kafka-connect-hdfs-ext

  View on GitHub
  Set of extensions for kafka connect hdfs
  ☆11May 12, 2021Updated 5 years ago
• Haricharanpanjwani / Application_Engineering_Design

  View on GitHub
  Projects based on IoT, Healthcare and Disaster Management
  ☆12May 2, 2016Updated 10 years ago