cpbaranwal/Spark-Streaming-DirectKafka-Examples external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

cpbaranwal/Spark-Streaming-DirectKafka-Examples

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/cpbaranwal/Spark-Streaming-DirectKafka-Examples)

Close

cpbaranwal / Spark-Streaming-DirectKafka-ExamplesView on GitHubMore

• External links
• Readme badge

DirectKafka examples for Spark Streaming : 1. with checkpointing 2. Custom offset management

☆59Sep 9, 2016Updated 10 years ago

Alternatives and similar repositories for Spark-Streaming-DirectKafka-Examples

Users that are interested in Spark-Streaming-DirectKafka-Examples are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• Gschiavon / Kafka-SparkStreaming-HDFS

  View on GitHub
  ☆14Nov 3, 2016Updated 9 years ago
• E-SoulDataGroup / spark_streaming_kafka_offset

  View on GitHub
  SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失
  ☆43Aug 2, 2017Updated 9 years ago
• cpbaranwal / Avro-SparkStreaming-Kafka

  View on GitHub
  Code for processing AVRO data in Spark Streaming + Kafka (DirectKafka approach with custom offset management in zookeeper)
  ☆29Sep 9, 2016Updated 10 years ago
• xlturing / spark-journey

  View on GitHub
  spark实例代码
  ☆78Nov 11, 2017Updated 8 years ago
• spirom / spark-streaming-with-kafka

  View on GitHub
  Self-contained examples of Apache Spark streaming integrated with Apache Kafka.
  ☆196Apr 15, 2018Updated 8 years ago
• GPU virtual machines on DigitalOcean Gradient AI • Ad
  Get to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
• mkuthan / example-spark-kafka

  View on GitHub
  Apache Spark and Apache Kafka integration example
  ☆121Dec 21, 2017Updated 8 years ago
• chimpler / blog-spark-streaming-log-aggregation

  View on GitHub
  Example of use of Spark Streaming with Kafka
  ☆89Jul 11, 2014Updated 12 years ago
• ippontech / spark-kafka-source

  View on GitHub
  Kafka stream for Spark with storage of the offsets in ZooKeeper
  ☆60Apr 18, 2017Updated 9 years ago
• onemax888 / streaming-offset-to-zk

  View on GitHub
  一个手动管理spark streaming集成kafka时的偏移量到zookeeper中的小项目
  ☆132Dec 17, 2025Updated 10 months ago
• ansrivas / spark-structured-streaming

  View on GitHub
  Spark structured streaming with Kafka data source and writing to Cassandra
  ☆62Dec 5, 2019Updated 6 years ago
• allwefantasy / spark-binlog

  View on GitHub
  A library for querying Binlog with Apache Spark structure streaming, for Spark SQL , DataFrames and [MLSQL](https://www.mlsql.tech).
  ☆151Apr 21, 2023Updated 3 years ago
• yamrcraft / etl-light

  View on GitHub
  A light Kafka to HDFS/S3 ETL library based on Apache Spark
  ☆40Jun 29, 2017Updated 9 years ago
• wangliangbd / SparkStreaming_Store_KafkaTopicOffset_To_HBase

  View on GitHub
  Kafka delivery semantics in the case of failure depend on how and when offsets are stored. Spark output operations are at-least-once. So …
  ☆38Apr 19, 2017Updated 9 years ago
• jerryshao / spark-hive-streaming-sink

  View on GitHub
  A sink to save Spark Structured Streaming DataFrame into Hive table
  ☆29Apr 16, 2018Updated 8 years ago
• Deploy on Railway without the complexity - Free Credits Offer • Ad
  Connect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
• cas-packone / ambari-impala-service

  View on GitHub
  make Impala on HDP enabled
  ☆51Aug 30, 2019Updated 7 years ago
• hseagle / presto

  View on GitHub
  Distributed SQL query engine for running interactive analytic queries against big data sources.
  ☆10Jul 1, 2016Updated 10 years ago
• onefoursix / Cloudera-Impala-JDBC-Example

  View on GitHub
  A Maven-based example of using Cloudera Impala's JDBC driver
  ☆118May 10, 2016Updated 10 years ago
• dantezhao / data-group

  View on GitHub
  ☆76Oct 22, 2018Updated 8 years ago
• flowers2023 / spark-streaming

  View on GitHub
  spark流数据处理，可以从flume-ng，kafka接收数据
  ☆11Sep 16, 2015Updated 11 years ago
• leoChaoGlut / presto-research

  View on GitHub
  presto 源码分析
  ☆50Feb 2, 2018Updated 8 years ago
• justinrmiller / spark-kafka-parquet-example

  View on GitHub
  An example project that combines Spark Streaming, Kafka, and Parquet to transform JSON objects streamed over Kafka into Parquet files in …
  ☆19Jun 22, 2021Updated 5 years ago
• DinoZhang / flink-connector-redis

  View on GitHub
  flink sql redis 连接器
  ☆12Nov 20, 2023Updated 2 years ago
• jrthe42 / aloha

  View on GitHub
  Aloha: a distributed task scheduling and management framework
  ☆65Dec 6, 2022Updated 3 years ago
• Deploy on Railway without the complexity - Free Credits Offer • Ad
  Connect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
• djkdeveloper / xss-filter-spring-boot-starter

  View on GitHub
  springboot auto xss
  ☆11May 23, 2018Updated 8 years ago
• findify / clickhouse-akka-stream

  View on GitHub
  Clickhouse sink for akka-streams
  ☆15Jan 3, 2022Updated 4 years ago
• Hanmourang / Pinot

  View on GitHub
  Pinot 是一个实时分布式的 OLAP 数据存储和分析系统。LinkedIn 使用它实现低延迟可伸缩的实时分析。Pinot 从离线数据源（包括 Hadoop 和各类文件）和在线数据源（如 Kafka）中攫取数据进行分析。Pinot 被设计是可以进行水平扩展的
  ☆16Nov 8, 2015Updated 10 years ago
• falarica / steerd-presto-operator

  View on GitHub
  Kubernetes (K8s) Operator for PrestoDB
  ☆46Sep 29, 2021Updated 5 years ago
• qiref / hbase-component

  View on GitHub
  利用SpringBoot整合HBase，基于HBaseJavaAPI的二次封装，可以直接引用jar包使用，目前测试已支持HBase1.1.2和HBase1.4.6以及HBase2.0.2三个版本。
  ☆15Sep 25, 2024Updated 2 years ago
• weibin0516 / spark-sourcecodes-analysis

  View on GitHub
  Spark源码剖析
  ☆86Nov 23, 2017Updated 8 years ago
• ken-hu / hui-bigdata-spark

  View on GitHub
  【bigdata】spirngboot+spark 脚手架+相关实例
  ☆22Jun 21, 2022Updated 4 years ago
• wypb / spark-summit-2017-Europe

  View on GitHub
  Spark summit 2017 europe ppt下载
  ☆43Nov 2, 2017Updated 9 years ago
• LeechanX / Netflix-Recommender-with-Spark

  View on GitHub
  基于Apache Spark的Netflix电影的离线与实时推荐系统
  ☆250Mar 21, 2017Updated 9 years ago
• GPU virtual machines on DigitalOcean Gradient AI • Ad
  Get to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
• anowls / spring-hadoop

  View on GitHub
  大数据实习hdfs+flume+kafka+spark+hbase+hive项目
  ☆35Jul 25, 2017Updated 9 years ago
• jacksu / utils4s

  View on GitHub
  scala、spark使用过程中，各种测试用例以及相关资料整理
  ☆1,077Feb 9, 2019Updated 7 years ago
• EdwardsBean / flume-spark-streaming

  View on GitHub
  conbine flume,spark-streaming and redis for real-time computing
  ☆22Oct 20, 2014Updated 12 years ago
• xuanzhao / imooc_spark_log_analysis

  View on GitHub
  以慕课网日志分析为例 进入大数据 Spark SQL 的世界
  ☆15Apr 3, 2018Updated 8 years ago
• gudaoxuri / ez-fs

  View on GitHub
  实现Local、FTP、HDFS文件系统的统一操作。
  ☆13May 12, 2016Updated 10 years ago
• caroljmcdonald / mapr-streams-sparkstreaming-hbase

  View on GitHub
  ☆24Apr 29, 2016Updated 10 years ago
• teamsoo / elasticsearch-ambari

  View on GitHub
  Elasticsearch Service for Ambari
  ☆14Feb 16, 2018Updated 8 years ago