gh-gan / SparkStreaming

Related projects ⓘ

Alternatives and complementary repositories for SparkStreaming

• duhanmin / structured-streaming-Kafka2HBase
  Spark structured-streaming 消费kafka数据写入hbase
  ☆33Updated 5 years ago
• E-SoulDataGroup / spark_streaming_kafka_offset
  SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失
  ☆45Updated 7 years ago
• winstonelei / BigDataTools
  tools for bigData
  ☆37Updated 5 years ago
• 344399160 / sparkForDB
  使用spark对hive、hbase、ES的读写， 实现一次配置可对不同数据库进行导入导出，并对ES、hbase进行封装
  ☆32Updated 7 years ago
• zhang637 / kafka_spark_hbase_demo
  kafka spark hbase 日志统计
  ☆80Updated 7 years ago
• LinMingQiang / spark-utils
  Encapsulated spark 与其他组件的结合api，方便使用，例如 es，hbase，kudu，kafka，mq等
  ☆35Updated 4 years ago
• peopleindreamdontsleep / StructuredStreamingInSQL
  sql实现Structured Streaming
  ☆39Updated 5 years ago
• windwant / bigdata-service
  hadoop flume hbase kafka storm；读取kafka数据=》storm实时处理（分割字符，统计字符）=》写入hdfs
  ☆21Updated 6 years ago
• a123demi / spring-sparkstreaming-kafka-10
  spring+spark streaming+kafka 10版本集成和异常问题处理
  ☆17Updated 7 years ago
• lttoto / SparkStreamingProject
  SparkStreaming项目，显示flume->Kafka->Spark->hbase(实时数据处理方案)，Scala实现
  ☆35Updated 6 years ago
• xianqiangHub / flink-practice
  log、event 、time 、window 、table、sql、connect、join、async IO、维表、CEP
  ☆69Updated 2 years ago
• xiaokugua250 / DataMingProject
  大数据平台相关代码（ES/Hive/Hadoop/hdfs/hbase）
  ☆74Updated 2 years ago
• ameyamk / spark-streaming-direct-kafka
  High Performance Spark Streaming with Direct Kafka in Java
  ☆39Updated 8 years ago
• TopSpoofer / hbrdd
  一个为spark批量导入数据到hbase的库
  ☆43Updated 8 years ago
• xxrznj / flink-kafka-sql
  kafka传数据到Flink存储到mysql之Flink使用SQL语句聚合数据流（设置时间窗口，EventTime）
  ☆31Updated 6 years ago
• 2shou / HBaseObserver
  通过HBase Observer同步数据到ElasticSearch
  ☆55Updated 9 years ago
• nagendra-avr / kafka-sparkstreaming-hbase
  ☆12Updated 8 years ago
• laixiangshun / bigdata-study
  大数据组件学习；包括dataflow，spring cloud stream；elasticsearch；flink；spark；kafka；phoenix；Hive；Hbase；
  ☆22Updated 2 years ago
• xinghalo / Teddy
  Spark Streaming监控平台，支持任务部署与告警、自启动
  ☆128Updated 6 years ago
• xuwei517 / FlinkProj
  Flink 案例代码
  ☆43Updated 2 years ago
• guofei1219 / SparkSQL
  SparkSQL数据分析案例
  ☆23Updated 7 years ago
• LinMingQiang / flink-learn
  Learning Flink : Flink CEP,Flink Core,Flink SQL
  ☆71Updated 2 years ago
• flowers2023 / spark-streaming
  spark流数据处理，可以从flume-ng，kafka接收数据
  ☆11Updated 9 years ago
• YunKillerE / sparkStreamingKafkaPerformance
  spark将hdfs数据高性能灌入kafka，然后spark streaming/structured streaming高速消费，关注性能，欢迎提供性能/代码优化建议
  ☆33Updated 5 years ago
• TopSpoofer / kafka-spark-streaming-to-hbase
  使用spark streaming 导入kafka数据到hbase
  ☆25Updated 8 years ago
• wangliangbd / SparkStreaming_Store_KafkaTopicOffset_To_HBase
  Kafka delivery semantics in the case of failure depend on how and when offsets are stored. Spark output operations are at-least-once. So …
  ☆37Updated 7 years ago
• xiaohei-info / Spark_DB_Connector
  Use Scala API to read/write data from different databases,HBase,MySQL,etc.
  ☆24Updated 6 years ago
• MOBIN-F / BigDataLearning
  总结了一些Spark学习过程中的例子（附代码详细注释）
  ☆24Updated 6 years ago