Gschiavon / Kafka-SparkStreaming-HDFS

Related projects: ⓘ

• elevy30 / bigdata-playground
  POC for all the stack of big data (kafka, spark, cassandra, hdfs, docker, springboot)
  ☆12Updated last year
• TopSpoofer / kafka-spark-streaming-to-hbase
  使用spark streaming 导入kafka数据到hbase
  ☆25Updated 8 years ago
• DRUNK2013 / spark-streaming
  spark流数据处理，可以从flume-ng，kafka接收数据
  ☆11Updated 9 years ago
• wgnet / spark-kafka-streaming
  Custom Spark Kafka consumer based on Kafka SimpleConsumer API.
  ☆22Updated 9 years ago
• mapr-demos / SparkStreamingHBaseExample
  Spark Streaming HBase Example
  ☆22Updated 8 years ago
• jerryshao / spark-hive-streaming-sink
  A sink to save Spark Structured Streaming DataFrame into Hive table
  ☆31Updated 6 years ago
• TopSpoofer / hbrdd
  一个为spark批量导入数据到hbase的库
  ☆43Updated 7 years ago
• gh-gan / SparkStreaming
  Streaming 相关项目
  ☆15Updated 7 years ago
• pchanumolu / Spark-Streaming-Apache-Kafka-Apache-HBase
  Spark Streaming example project which pulls messages from Kafka and write to HBase Table.
  ☆11Updated 9 years ago
• cpbaranwal / Avro-SparkStreaming-Kafka
  Code for processing AVRO data in Spark Streaming + Kafka (DirectKafka approach with custom offset management in zookeeper)
  ☆29Updated 8 years ago
• YunKillerE / sparkStreamingKafkaPerformance
  spark将hdfs数据高性能灌入kafka，然后spark streaming/structured streaming高速消费，关注性能，欢迎提供性能/代码优化建议
  ☆33Updated 5 years ago
• compae / SparkSqlExamples
  Using Spark SQLContext, HiveContext & Spark DataFrames API with ElasticSearch, Cassandra & MongoDB
  ☆22Updated 8 years ago
• PU-101 / spark-etl
  因现有的datax、sqoop满足不了需求，使用spark封装了一个数据同步工具。
  ☆9Updated 5 years ago
• LinMingQiang / spark-utils
  Encapsulated spark 与其他组件的结合api，方便使用，例如 es，hbase，kudu，kafka，mq等
  ☆35Updated 4 years ago
• jizhang / spark-sandbox
  A playground for Spark jobs.
  ☆44Updated 5 years ago
• allwefantasy / spark-hbase
  A HBase datasource implementation for Spark and [MLSQL](http://www.mlsql.tech).
  ☆13Updated 11 months ago
• LuckyZXL2016 / Spark-Example
  Spark1.6和spark2.2的示例，包含kafka,flume,structuredstreaming,jedis,elasticsearch,mysql,dataframe
  ☆15Updated 6 years ago
• OopsOutOfMemory / spark-sql-hbase
  A Spark SQL HBase connector
  ☆29Updated 9 years ago
• bjkonglu / resume-bjkonglu
  记录Spark、Flink研究经验
  ☆25Updated 5 years ago
• guofei1219 / SparkSQL
  SparkSQL数据分析案例
  ☆23Updated 7 years ago
• nagendra-avr / kafka-sparkstreaming-hbase
  ☆12Updated 8 years ago
• dijiekstra / flinksql
  Flink Sql 教程
  ☆34Updated 2 years ago
• wangliangbd / SparkStreaming_Store_KafkaTopicOffset_To_HBase
  Kafka delivery semantics in the case of failure depend on how and when offsets are stored. Spark output operations are at-least-once. So …
  ☆37Updated 7 years ago
• datafibers-community / df_data_service
  DataFibers Data Service
  ☆31Updated 2 years ago
• E-SoulDataGroup / spark_streaming_kafka_offset
  SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失
  ☆45Updated 7 years ago
• sev7e0 / wow-spark
  spark自学手册，包含了例如spark core、spark sql、spark streaming、spark-kafka、delta-lake，以及scala基础练习，还有一些例如master、shuffle源码分析，总结及翻译。
  ☆18Updated last year
• cpbaranwal / Spark-Streaming-DirectKafka-Examples
  DirectKafka examples for Spark Streaming : 1. with checkpointing 2. Custom offset management
  ☆61Updated 8 years ago
• stefcorda / sparkStreamingETL
  Project to create configurable ETL via lightbend configuration using Spark Structured Streaming
  ☆8Updated 6 years ago
• lucasbak / kafka-spark-streaming
  Project for reading data from kafka and writing to kafka and HBase with kerberos
  ☆24Updated 7 years ago
• gdtm86 / spark-streaming-kafka-cdh511-testing
  Spark Streaming,Kafka and HBase code accompanying the blog 'Offset Management For Apache Kafka With Apache Spark Streaming'
  ☆23Updated 7 years ago