xiyuan-fengyu / HBaseManager
对HBase API的简单封装,Java和Scala混编
☆8Updated 7 years ago
Related projects: ⓘ
- spark将hdfs数据高性能灌入kafka,然后spark streaming/structured streaming高速消费,关注性能,欢迎提供性能/代码优化建议☆33Updated 5 years ago
- SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失☆45Updated 7 years ago
- Encapsulated spark 与其他组件的结合api,方便使用,例如 es,hbase,kudu,kafka,mq等☆35Updated 4 years ago
- sql实现Structured Streaming☆39Updated 5 years ago
- 因现有的datax、sqoop满足不了需求,使用spark封装了一个数据同步工具。☆9Updated 5 years ago
- 一个为spark批量导入数据到hbase的库☆43Updated 7 years ago
- Kafka delivery semantics in the case of failure depend on how and when offsets are stored. Spark output operations are at-least-once. So …☆37Updated 7 years ago
- Spark structured-streaming 消费kafka数据写入hbase☆34Updated 5 years ago
- This is a based on playframwork for submit spark app☆60Updated last year
- 手动管理spark streaming集成kafka的数据偏移量到zookeeper中☆22Updated 6 years ago
- sql解析和执行,能够执行hive, spark, flink, 以及对应对TensorFlow, Deeplearning4j的算法SQL执行☆11Updated 2 years ago
- A sink to save Spark Structured Streaming DataFrame into Hive table☆31Updated 6 years ago
- Flink Sql 教程☆34Updated 2 years ago
- A library based on delta for Spark and MLSQL☆61Updated 3 years ago
- My Blog☆76Updated 6 years ago
- A playground for Spark jobs.☆44Updated 5 years ago
- A HBase datasource implementation for Spark and [MLSQL](http://www.mlsql.tech).☆13Updated 11 months ago
- flinksql-platform☆19Updated 3 years ago
- SparkSQL数据分析案例☆23Updated 7 years ago
- 基于 spark 混合查询平台,支持不同源数据库的联合查询,mysql hive presto ...☆14Updated 7 years ago
- Data self exporting and monitoring platform based on Hive data warehouse. https://hc.smartloli.org☆35Updated 7 years ago
- spark流数据处理,可以从flume-ng,kafka接收数据☆11Updated 9 years ago
- Streaming 相关项目☆15Updated 7 years ago
- SparkSQL自定义Hint优化器解决热点数据导致JOIN数据倾斜问题☆48Updated 5 years ago
- 基于袋鼠云提供的开源flinkStreamSQL项目,对其实时sql进行可视化功能开发;通过tcpip通信,前端页面选择需要连接的数据库信息,并写sql语句,点击提交后,后端自动执行集群启动和JobGraph提交,并返回结果给前端页面。实现了使用者即使不了解Kafka、fl…☆11Updated 5 years ago
- ☆38Updated last year
- Learning Flink : Flink CEP,Flink Core,Flink SQL☆71Updated 2 years ago
- 优化flink的多流操作(例如join),优化点不限于数据丢失问题,以及性能问题☆11Updated 5 years ago
- 使用spark对hive、hbase、ES的读写, 实现一次配置可对不同数据库进行导入导出, 并对ES、hbase进行封装☆32Updated 7 years ago
- springmvc+phoenix操作hbase的web架构☆10Updated 6 years ago