cpbaranwal/Spark-Streaming-DirectKafka-Examples external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

cpbaranwal/Spark-Streaming-DirectKafka-Examples

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/cpbaranwal/Spark-Streaming-DirectKafka-Examples)

Close

cpbaranwal / Spark-Streaming-DirectKafka-ExamplesView on GitHubMore

• External links
• Readme badge

DirectKafka examples for Spark Streaming : 1. with checkpointing 2. Custom offset management

☆59Sep 9, 2016Updated 9 years ago

Alternatives and similar repositories for Spark-Streaming-DirectKafka-Examples

Users that are interested in Spark-Streaming-DirectKafka-Examples are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• Gschiavon / Kafka-SparkStreaming-HDFS

  View on GitHub
  ☆14Nov 3, 2016Updated 9 years ago
• E-SoulDataGroup / spark_streaming_kafka_offset

  View on GitHub
  SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失
  ☆43Aug 2, 2017Updated 8 years ago
• cpbaranwal / Avro-SparkStreaming-Kafka

  View on GitHub
  Code for processing AVRO data in Spark Streaming + Kafka (DirectKafka approach with custom offset management in zookeeper)
  ☆29Sep 9, 2016Updated 9 years ago
• koeninger / kafka-exactly-once

  View on GitHub
  ☆242Jun 14, 2018Updated 8 years ago
• tresata / spark-kafka

  View on GitHub
  Low level integration of Spark and Kafka
  ☆129Mar 15, 2018Updated 8 years ago
• Wordpress hosting with auto-scaling - Free Trial Offer • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• chimpler / blog-spark-streaming-log-aggregation

  View on GitHub
  Example of use of Spark Streaming with Kafka
  ☆89Jul 11, 2014Updated 11 years ago
• ansrivas / spark-structured-streaming

  View on GitHub
  Spark structured streaming with Kafka data source and writing to Cassandra
  ☆62Dec 5, 2019Updated 6 years ago
• gdtm86 / spark-streaming-kafka-cdh511-testing

  View on GitHub
  Spark Streaming,Kafka and HBase code accompanying the blog 'Offset Management For Apache Kafka With Apache Spark Streaming'
  ☆23Jun 26, 2017Updated 9 years ago
• qindongliang / streaming-offset-to-zk

  View on GitHub
  一个手动管理spark streaming集成kafka时的偏移量到zookeeper中的小项目
  ☆133Dec 17, 2025Updated 6 months ago
• xlturing / spark-journey

  View on GitHub
  spark实例代码
  ☆78Nov 11, 2017Updated 8 years ago
• wangliangbd / SparkStreaming_Store_KafkaTopicOffset_To_HBase

  View on GitHub
  Kafka delivery semantics in the case of failure depend on how and when offsets are stored. Spark output operations are at-least-once. So …
  ☆38Apr 19, 2017Updated 9 years ago
• allwefantasy / spark-binlog

  View on GitHub
  A library for querying Binlog with Apache Spark structure streaming, for Spark SQL , DataFrames and [MLSQL](https://www.mlsql.tech).
  ☆152Apr 21, 2023Updated 3 years ago
• yamrcraft / etl-light

  View on GitHub
  A light Kafka to HDFS/S3 ETL library based on Apache Spark
  ☆40Jun 29, 2017Updated 9 years ago
• mkuthan / example-spark-kafka

  View on GitHub
  Apache Spark and Apache Kafka integration example
  ☆122Dec 21, 2017Updated 8 years ago
• Virtual machines for every use case on DigitalOcean • Ad
  Get dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
• jerryshao / spark-hive-streaming-sink

  View on GitHub
  A sink to save Spark Structured Streaming DataFrame into Hive table
  ☆29Apr 16, 2018Updated 8 years ago
• onefoursix / Cloudera-Impala-JDBC-Example

  View on GitHub
  A Maven-based example of using Cloudera Impala's JDBC driver
  ☆117May 10, 2016Updated 10 years ago
• dantezhao / data-group

  View on GitHub
  ☆77Oct 22, 2018Updated 7 years ago
• DinoZhang / flink-connector-redis

  View on GitHub
  flink sql redis 连接器
  ☆12Nov 20, 2023Updated 2 years ago
• justinrmiller / spark-kafka-parquet-example

  View on GitHub
  An example project that combines Spark Streaming, Kafka, and Parquet to transform JSON objects streamed over Kafka into Parquet files in …
  ☆19Jun 22, 2021Updated 5 years ago
• WeichenXu123 / spark-ml-source-analysis

  View on GitHub
  spark ml 算法原理剖析以及具体的源码实现分析
  ☆10Jan 25, 2017Updated 9 years ago
• cjuexuan / mynote

  View on GitHub
  ☆233Sep 15, 2022Updated 3 years ago
• fayson / cdhproject

  View on GitHub
  hadoop各组件使用，持续更新
  ☆897Jan 4, 2023Updated 3 years ago
• jrthe42 / aloha

  View on GitHub
  Aloha: a distributed task scheduling and management framework
  ☆65Dec 6, 2022Updated 3 years ago
• 1-Click AI Models by DigitalOcean Gradient • Ad
  Deploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
• qindongliang / Java-Note

  View on GitHub
  Java相关的笔记
  ☆12Apr 8, 2021Updated 5 years ago
• findify / clickhouse-akka-stream

  View on GitHub
  Clickhouse sink for akka-streams
  ☆15Jan 3, 2022Updated 4 years ago
• EdwardsBean / flume-spark-streaming

  View on GitHub
  conbine flume,spark-streaming and redis for real-time computing
  ☆22Oct 20, 2014Updated 11 years ago
• weibin0516 / spark-sourcecodes-analysis

  View on GitHub
  Spark源码剖析
  ☆86Nov 23, 2017Updated 8 years ago
• wypb / spark-summit-2017-Europe

  View on GitHub
  Spark summit 2017 europe ppt下载
  ☆43Nov 2, 2017Updated 8 years ago
• zeeshanabid94 / presto

  View on GitHub
  Distributed SQL query engine for big data
  ☆31Mar 12, 2019Updated 7 years ago
• gudaoxuri / ez-fs

  View on GitHub
  实现Local、FTP、HDFS文件系统的统一操作。
  ☆13May 12, 2016Updated 10 years ago
• ken-hu / hui-bigdata-spark

  View on GitHub
  【bigdata】spirngboot+spark 脚手架+相关实例
  ☆22Jun 21, 2022Updated 4 years ago
• caroljmcdonald / mapr-streams-sparkstreaming-hbase

  View on GitHub
  ☆24Apr 29, 2016Updated 10 years ago
• Open source password manager - Proton Pass • Ad
  Securely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
• jacksu / utils4s

  View on GitHub
  scala、spark使用过程中，各种测试用例以及相关资料整理
  ☆1,085Feb 9, 2019Updated 7 years ago
• cas-packone / ambari-impala-service

  View on GitHub
  make Impala on HDP enabled
  ☆51Aug 30, 2019Updated 6 years ago
• xuanzhao / imooc_spark_log_analysis

  View on GitHub
  以慕课网日志分析为例 进入大数据 Spark SQL 的世界
  ☆15Apr 3, 2018Updated 8 years ago
• leoChaoGlut / presto-research

  View on GitHub
  presto 源码分析
  ☆50Feb 2, 2018Updated 8 years ago
• xubo245 / CarbonDataLearning

  View on GitHub
  Apache CarbonData Learning
  ☆53Mar 5, 2020Updated 6 years ago
• anowls / spring-hadoop

  View on GitHub
  大数据实习hdfs+flume+kafka+spark+hbase+hive项目
  ☆35Jul 25, 2017Updated 8 years ago
• bluebreezecf / SparkJobServerClient

  View on GitHub
  Java Client of the Spark Job Server implementing the arranged Rest APIs
  ☆52Jun 4, 2021Updated 5 years ago