LiShuMing / spark-demosLinks
Spark(multi versions) + Streaming/Hive/SQL/UDF Demos
☆15Updated 7 years ago
Alternatives and similar repositories for spark-demos
Users that are interested in spark-demos are comparing it to the libraries listed below
Sorting:
- Kafka delivery semantics in the case of failure depend on how and when offsets are stored. Spark output operations are at-least-once. So …☆37Updated 8 years ago
- My Blog☆76Updated 7 years ago
- Spark Streaming监控平台，支持任务部署与告警、自启动☆128Updated 7 years ago
- spark实例代码☆78Updated 7 years ago
- kudu学习的一些资料，以及和spark/impala的集成使用☆33Updated 7 years ago
- Data self exporting and monitoring platform based on Hive data warehouse. https://hc.smartloli.org☆36Updated 7 years ago
- mysql数据实时增量导入hive☆87Updated 8 years ago
- Encapsulated spark 与其他组件的结合api，方便使用，例如 es，hbase，kudu，kafka，mq等☆35Updated 5 years ago
- 记录Spark、Flink研究经验☆26Updated 5 years ago
- SparkStreaming中利用MySQL保存Kafka偏移量保证0 数据丢失☆45Updated 7 years ago
- 一个为spark批量导入数据到hbase的库☆43Updated 8 years ago
- hadoop (hadoop,hive,hue,hbase) deployer☆111Updated 11 years ago
- Spark 脚手架工程，标准化 spark 开发、部署、测试流程。☆94Updated 8 months ago
- sql实现Structured Streaming☆39Updated 6 years ago
- 基于CDH5.x parcles安 装，一键卸载脚本☆38Updated 2 years ago
- ☆42Updated 6 years ago
- Java library to integrate Flink and Kudu☆54Updated 7 years ago
- Spark源代码中文注释☆42Updated 6 years ago
- 通过HBase Observer同步数据到ElasticSearch☆55Updated 10 years ago
- hbase-tools try easy to use and test the hbase,☆46Updated 11 years ago
- hbase+solr实现hbase的二级索引☆48Updated 3 months ago
- azkaban小助手,增加任务web配置、远程脚本调用、报警扩展、跨项目依赖等功能。☆117Updated 8 years ago
- flink技术学习笔记分享☆82Updated 6 years ago
- Spark Streaming,Kafka and HBase code accompanying the blog 'Offset Management For Apache Kafka With Apache Spark Streaming'☆23Updated 7 years ago
- Spark structured-streaming 消费kafka数据写入hbase☆33Updated 6 years ago
- spark将hdfs数据高性能灌入kafka，然后spark streaming/structured streaming高速消费，关注性能，欢迎提供性能/代码优化建议☆33Updated 6 years ago
- DirectKafka examples for Spark Streaming : 1. with checkpointing 2. Custom offset management☆60Updated 8 years ago
- 同步Hive数据仓库数据到Elasticsearch的小工具☆21Updated 7 years ago
- 基于Java，封装了hbase的底层api，提供了基于注解的ORM支持，只需定义实体类对象，即可完成对hbase的各种操作。同时对List、Set、Map等复杂数据类型提供了支持☆43Updated 8 years ago
- ☆30Updated 2 years ago