cpbaranwal/Spark-Streaming-DirectKafka-Examples external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

cpbaranwal/Spark-Streaming-DirectKafka-Examples

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/cpbaranwal/Spark-Streaming-DirectKafka-Examples)

Close

cpbaranwal / Spark-Streaming-DirectKafka-ExamplesView on GitHubMore

• External links
• Readme badge

DirectKafka examples for Spark Streaming : 1. with checkpointing 2. Custom offset management

☆60Sep 9, 2016Updated 9 years ago

Alternatives and similar repositories for Spark-Streaming-DirectKafka-Examples

Users that are interested in Spark-Streaming-DirectKafka-Examples are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• Gschiavon / Kafka-SparkStreaming-HDFS

  View on GitHub
  ☆14Nov 3, 2016Updated 9 years ago
• E-SoulDataGroup / spark_streaming_kafka_offset

  View on GitHub
  SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失
  ☆43Aug 2, 2017Updated 8 years ago
• cpbaranwal / Avro-SparkStreaming-Kafka

  View on GitHub
  Code for processing AVRO data in Spark Streaming + Kafka (DirectKafka approach with custom offset management in zookeeper)
  ☆29Sep 9, 2016Updated 9 years ago
• koeninger / kafka-exactly-once

  View on GitHub
  ☆242Jun 14, 2018Updated 8 years ago
• tresata / spark-kafka

  View on GitHub
  Low level integration of Spark and Kafka
  ☆129Mar 15, 2018Updated 8 years ago
• Managed Kubernetes at scale on DigitalOcean • Ad
  DigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
• chimpler / blog-spark-streaming-log-aggregation

  View on GitHub
  Example of use of Spark Streaming with Kafka
  ☆90Jul 11, 2014Updated 11 years ago
• spirom / spark-streaming-with-kafka

  View on GitHub
  Self-contained examples of Apache Spark streaming integrated with Apache Kafka.
  ☆196Apr 15, 2018Updated 8 years ago
• ippontech / spark-kafka-source

  View on GitHub
  Kafka stream for Spark with storage of the offsets in ZooKeeper
  ☆60Apr 18, 2017Updated 9 years ago
• ansrivas / spark-structured-streaming

  View on GitHub
  Spark structured streaming with Kafka data source and writing to Cassandra
  ☆62Dec 5, 2019Updated 6 years ago
• gdtm86 / spark-streaming-kafka-cdh511-testing

  View on GitHub
  Spark Streaming,Kafka and HBase code accompanying the blog 'Offset Management For Apache Kafka With Apache Spark Streaming'
  ☆23Jun 26, 2017Updated 8 years ago
• qindongliang / streaming-offset-to-zk

  View on GitHub
  一个手动管理spark streaming集成kafka时的偏移量到zookeeper中的小项目
  ☆133Dec 17, 2025Updated 5 months ago
• xlturing / spark-journey

  View on GitHub
  spark实例代码
  ☆78Nov 11, 2017Updated 8 years ago
• wangliangbd / SparkStreaming_Store_KafkaTopicOffset_To_HBase

  View on GitHub
  Kafka delivery semantics in the case of failure depend on how and when offsets are stored. Spark output operations are at-least-once. So …
  ☆37Apr 19, 2017Updated 9 years ago
• allwefantasy / spark-binlog

  View on GitHub
  A library for querying Binlog with Apache Spark structure streaming, for Spark SQL , DataFrames and [MLSQL](https://www.mlsql.tech).
  ☆153Apr 21, 2023Updated 3 years ago
• Open source password manager - Proton Pass • Ad
  Securely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
• yamrcraft / etl-light

  View on GitHub
  A light Kafka to HDFS/S3 ETL library based on Apache Spark
  ☆40Jun 29, 2017Updated 8 years ago
• mkuthan / example-spark-kafka

  View on GitHub
  Apache Spark and Apache Kafka integration example
  ☆122Dec 21, 2017Updated 8 years ago
• onefoursix / Cloudera-Impala-JDBC-Example

  View on GitHub
  A Maven-based example of using Cloudera Impala's JDBC driver
  ☆117May 10, 2016Updated 10 years ago
• dantezhao / data-group

  View on GitHub
  ☆77Oct 22, 2018Updated 7 years ago
• DinoZhang / flink-connector-redis

  View on GitHub
  flink sql redis 连接器
  ☆12Nov 20, 2023Updated 2 years ago
• justinrmiller / spark-kafka-parquet-example

  View on GitHub
  An example project that combines Spark Streaming, Kafka, and Parquet to transform JSON objects streamed over Kafka into Parquet files in …
  ☆19Jun 22, 2021Updated 4 years ago
• WeichenXu123 / spark-ml-source-analysis

  View on GitHub
  spark ml 算法原理剖析以及具体的源码实现分析
  ☆10Jan 25, 2017Updated 9 years ago
• cjuexuan / mynote

  View on GitHub
  ☆234Sep 15, 2022Updated 3 years ago
• zhangjr-gaoyou / spring-boot-spark-demo

  View on GitHub
  使用spring-boot-spark的一个样例
  ☆11Aug 3, 2018Updated 7 years ago
• Wordpress hosting with auto-scaling - Free Trial Offer • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• fayson / cdhproject

  View on GitHub
  hadoop各组件使用，持续更新
  ☆897Jan 4, 2023Updated 3 years ago
• BenFradet / spark-kafka-writer

  View on GitHub
  Write your Spark data to Kafka seamlessly
  ☆173Jul 10, 2024Updated last year
• teamsoo / elasticsearch-ambari

  View on GitHub
  Elasticsearch Service for Ambari
  ☆14Feb 16, 2018Updated 8 years ago
• jrthe42 / aloha

  View on GitHub
  Aloha: a distributed task scheduling and management framework
  ☆65Dec 6, 2022Updated 3 years ago
• djkdeveloper / xss-filter-spring-boot-starter

  View on GitHub
  springboot auto xss
  ☆11May 23, 2018Updated 8 years ago
• qindongliang / Java-Note

  View on GitHub
  Java相关的笔记
  ☆12Apr 8, 2021Updated 5 years ago
• findify / clickhouse-akka-stream

  View on GitHub
  Clickhouse sink for akka-streams
  ☆16Jan 3, 2022Updated 4 years ago
• EdwardsBean / flume-spark-streaming

  View on GitHub
  conbine flume,spark-streaming and redis for real-time computing
  ☆22Oct 20, 2014Updated 11 years ago
• gudaoxuri / ez-fs

  View on GitHub
  实现Local、FTP、HDFS文件系统的统一操作。
  ☆13May 12, 2016Updated 10 years ago
• GPU virtual machines on DigitalOcean Gradient AI • Ad
  Get to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
• LeechanX / Netflix-Recommender-with-Spark

  View on GitHub
  基于Apache Spark的Netflix电影的离线与实时推荐系统
  ☆250Mar 21, 2017Updated 9 years ago
• ken-hu / hui-bigdata-spark

  View on GitHub
  【bigdata】spirngboot+spark 脚手架+相关实例
  ☆22Jun 21, 2022Updated 3 years ago
• caroljmcdonald / mapr-streams-sparkstreaming-hbase

  View on GitHub
  ☆24Apr 29, 2016Updated 10 years ago
• cas-packone / ambari-impala-service

  View on GitHub
  make Impala on HDP enabled
  ☆51Aug 30, 2019Updated 6 years ago
• xuanzhao / imooc_spark_log_analysis

  View on GitHub
  以慕课网日志分析为例 进入大数据 Spark SQL 的世界
  ☆15Apr 3, 2018Updated 8 years ago
• leoChaoGlut / presto-research

  View on GitHub
  presto 源码分析
  ☆51Feb 2, 2018Updated 8 years ago
• xubo245 / CarbonDataLearning

  View on GitHub
  Apache CarbonData Learning
  ☆53Mar 5, 2020Updated 6 years ago