Alternatives and similar repositories for Kafka-SparkStreaming-HDFS

Users that are interested in Kafka-SparkStreaming-HDFS are comparing it to the libraries listed below

• gh-gan / SparkStreaming

  View on GitHub
  Streaming 相关项目
  ☆15Mar 27, 2017Updated 8 years ago
• mapr-demos / SparkStreamingHBaseExample

  View on GitHub
  Spark Streaming HBase Example
  ☆22Mar 16, 2016Updated 9 years ago
• nagendra-avr / kafka-sparkstreaming-hbase

  View on GitHub
  ☆12May 11, 2016Updated 9 years ago
• TopSpoofer / kafka-spark-streaming-to-hbase

  View on GitHub
  使用spark streaming 导入kafka数据到hbase
  ☆25Apr 14, 2016Updated 9 years ago
• flowers2023 / spark-streaming

  View on GitHub
  spark流数据处理，可以从flume-ng，kafka接收数据
  ☆11Sep 16, 2015Updated 10 years ago
• vaquarkhan / apache-kafka-spark-streaming-poc

  View on GitHub
  Apache-kafka-spark-streaming-poc
  ☆10Mar 19, 2017Updated 8 years ago
• pchanumolu / Spark-Streaming-Apache-Kafka-Apache-HBase

  View on GitHub
  Spark Streaming example project which pulls messages from Kafka and write to HBase Table.
  ☆11Jul 5, 2015Updated 10 years ago
• duhanmin / structured-streaming-Kafka2HBase

  View on GitHub
  Spark structured-streaming 消费kafka数据写入hbase
  ☆33Jan 22, 2019Updated 7 years ago
• luop23 / sql_analysis

  View on GitHub
  基于jsqlparser 进行sql语句解析，得到字段间的血缘关系（即所查询字段来源于哪张表中的哪个字段）
  ☆19Oct 6, 2023Updated 2 years ago
• wangliangbd / SparkStreaming_Store_KafkaTopicOffset_To_HBase

  View on GitHub
  Kafka delivery semantics in the case of failure depend on how and when offsets are stored. Spark output operations are at-least-once. So …
  ☆37Apr 19, 2017Updated 8 years ago
• justinrmiller / spark-kafka-parquet-example

  View on GitHub
  An example project that combines Spark Streaming, Kafka, and Parquet to transform JSON objects streamed over Kafka into Parquet files in …
  ☆19Jun 22, 2021Updated 4 years ago
• cpbaranwal / Spark-Streaming-DirectKafka-Examples

  View on GitHub
  DirectKafka examples for Spark Streaming : 1. with checkpointing 2. Custom offset management
  ☆60Sep 9, 2016Updated 9 years ago
• EdwardsBean / flume-spark-streaming

  View on GitHub
  conbine flume,spark-streaming and redis for real-time computing
  ☆22Oct 20, 2014Updated 11 years ago
• E-SoulDataGroup / spark_streaming_kafka_offset

  View on GitHub
  SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失
  ☆44Aug 2, 2017Updated 8 years ago
• JoseRFJuniorLLMs / PySpark-ETL

  View on GitHub
  PySpark-ETL
  ☆22Dec 16, 2019Updated 6 years ago
• compae / SparkSqlExamples

  View on GitHub
  Using Spark SQLContext, HiveContext & Spark DataFrames API with ElasticSearch, Cassandra & MongoDB
  ☆22Sep 13, 2016Updated 9 years ago
• looker / spark_log_data

  View on GitHub
  Flume-to-Spark-Streaming Log Parser
  ☆23Jun 3, 2016Updated 9 years ago
• xiaohei-info / Spark_DB_Connector

  View on GitHub
  Use Scala API to read/write data from different databases,HBase,MySQL,etc.
  ☆24Feb 28, 2018Updated 7 years ago
• SelfEvoAI / sparkStreamingKafkaPerformance

  View on GitHub
  spark将hdfs数据高性能灌入kafka，然后spark streaming/structured streaming高速消费，关注性能，欢迎提供性能/代码优化建议
  ☆33Mar 24, 2019Updated 6 years ago
• OopsOutOfMemory / spark-sql-hbase

  View on GitHub
  A Spark SQL HBase connector
  ☆29May 4, 2015Updated 10 years ago
• GarajedeIdeas / CodePills-Face-Recognition

  View on GitHub
  ☆12Feb 22, 2023Updated 2 years ago
• LinMingQiang / flink-learn

  View on GitHub
  Learning Flink : Flink CEP,Flink Core,Flink SQL
  ☆73Feb 21, 2022Updated 3 years ago
• WangYang-wy / YangDocker

  View on GitHub
  自助搭建的 hadoop + spark + kafka + zookeeper + storm + hbase + hive + flume 集群，一主两从。
  ☆31Jan 16, 2019Updated 7 years ago
• designcourse / ng5

  View on GitHub
  ☆16Apr 8, 2018Updated 7 years ago
• GabySol / OmesTutorials2021

  View on GitHub
  ☆13Jun 28, 2021Updated 4 years ago
• drabastomek / learningPySpark_video

  View on GitHub
  Learning PySpark video series
  ☆11Mar 5, 2018Updated 7 years ago
• pinarersoy / PySpark_SparkSQL_MLib

  View on GitHub
  Includes several examples of data manipulation techniques by using PySpark and machine learning algorithms using MLib
  ☆10Jun 14, 2021Updated 4 years ago
• LucaZou / table-agent

  View on GitHub
  基于FastAPI + LangChain + OpenAI API + Vue的AI表格处理工具，用于智能化处理和分析表格数据。
  ☆17Jul 14, 2025Updated 7 months ago
• jerryygit / ZRDSL

  View on GitHub
  json或SQL语言转为flink或者spark流/批任务
  ☆12Jun 21, 2022Updated 3 years ago
• mkt-Do / replicated-clickhouse

  View on GitHub
  ☆10Feb 12, 2020Updated 6 years ago
• thegodofwar / MR_HBase

  View on GitHub
  hadoop中Map/Reduce使用示例，输入(DBInputFormat),输出(DBOutputFormat)为MySql数据库表、日志分析Grep、单词排序Sort...对HBase的基本操作，增、删、查、改，使用Map/Reduce批量导入数据到HBase表中..…
  ☆14Apr 6, 2013Updated 12 years ago
• jakewright / drawbridge

  View on GitHub
  Drawbridge is a lightweight API gateway written in Go
  ☆12Apr 18, 2020Updated 5 years ago
• GET-TUDA-CHOPPA / AIandGames

  View on GitHub
  Code repository for tutorial sample code, solutions and demos hosted on AIandGames.com
  ☆10Sep 20, 2017Updated 8 years ago
• leno1001 / spark_monitor

  View on GitHub
  请求spark rest API获取applications，jobs，stages，executors，rdds，streaming，environment等信息提供监控和报警服务
  ☆11Nov 22, 2018Updated 7 years ago
• robertbunch / face-api-js-starter

  View on GitHub
  ☆11Jan 14, 2024Updated 2 years ago
• dheeraj3choudhary / AWS_Lambda

  View on GitHub
  Lamda code written in python
  ☆14Oct 22, 2022Updated 3 years ago
• helloworlde / k8s-spring-boot-demo

  View on GitHub
  Kubenetes with SpringBoot demo
  ☆10Feb 20, 2019Updated 6 years ago
• anowls / spring-hadoop

  View on GitHub
  大数据实习hdfs+flume+kafka+spark+hbase+hive项目
  ☆35Jul 25, 2017Updated 8 years ago
• mvalleavila / Kafka-Spark-Hbase-Example

  View on GitHub
  ☆38Aug 19, 2015Updated 10 years ago