LiShuMing / spark-demos
Spark(multi versions) + Streaming/Hive/SQL/UDF Demos
☆15Updated 6 years ago
Related projects: ⓘ
- Encapsulated spark 与其他组件的结合api，方便使用，例如 es，hbase，kudu，kafka，mq等☆35Updated 4 years ago
- SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失☆45Updated 7 years ago
- kudu学习的一些资料，以及和spark/impala的集成使用☆33Updated 7 years ago
- Kafka delivery semantics in the case of failure depend on how and when offsets are stored. Spark output operations are at-least-once. So …☆37Updated 7 years ago
- 记录Spark、Flink研究经验☆25Updated 5 years ago
- 一个为spark批量导入数据到hbase的库☆43Updated 7 years ago
- Data self exporting and monitoring platform based on Hive data warehouse. https://hc.smartloli.org☆35Updated 7 years ago
- ☆43Updated 5 years ago
- 对yarn的的RM,NM模块代码进行分析☆48Updated 6 years ago
- spark实例代码☆78Updated 6 years ago
- Spark Streaming监控平台，支持任务部署与告警、自启动☆128Updated 6 years ago
- Spark Streaming,Kafka and HBase code accompanying the blog 'Offset Management For Apache Kafka With Apache Spark Streaming'☆23Updated 7 years ago
- ☆26Updated this week
- My Blog☆76Updated 6 years ago
- sql实现Structured Streaming☆39Updated 5 years ago
- mysql数据实时增量导入hive☆86Updated 7 years ago
- spark将hdfs数据高性能灌入kafka，然后spark streaming/structured streaming高速消费，关注性能，欢迎提供性能/代码优化建议☆33Updated 5 years ago
- Java library to integrate Flink and Kudu☆53Updated 7 years ago
- ☆70Updated this week
- 使用Hive读写solr☆31Updated 2 years ago
- hbase-tools try easy to use and test the hbase,☆46Updated 10 years ago
- 基于Yarn的容器调度引擎(container scheduler based on yarn)☆37Updated 8 years ago
- hbase+solr实现hbase的二级索引☆47Updated 3 years ago
- 通过HBase Observer同步数据到ElasticSearch☆55Updated 9 years ago
- A playground for Spark jobs.☆44Updated 5 years ago
- 使用spark streaming 导入kafka数据到hbase☆25Updated 8 years ago
- SparkSQL数据分析案例☆23Updated 7 years ago
- 同步Hive数据仓库数据到Elasticsearch的小工具☆21Updated 6 years ago
- ☆33Updated 5 years ago
- Spark structured-streaming 消费kafka数据写入hbase☆34Updated 5 years ago