leno1001 / spark_monitor
请求spark rest API获取applications，jobs，stages，executors，rdds，streaming，environment等信息提供监控和报警服务
☆11Updated 6 years ago
Related projects ⓘ
Alternatives and complementary repositories for spark_monitor
- SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失☆45Updated 7 years ago
- Use Scala API to read/write data from different databases,HBase,MySQL,etc.☆24Updated 6 years ago
- Kafka delivery semantics in the case of failure depend on how and when offsets are stored. Spark output operations are at-least-once. So …☆37Updated 7 years ago
- graphx知识图谱、图计算相关☆64Updated 7 years ago
- spark将hdfs数据高性能灌入kafka，然后spark streaming/structured streaming高速消费，关注性能，欢迎提供性能/代码优化建议☆33Updated 5 years ago
- Spark Mllib 1.6.0版本算法封装☆11Updated 7 years ago
- Deep Learning Pipelines for Apache Spark☆58Updated 6 years ago
- My Blog☆76Updated 6 years ago
- SparkSQL数据分析案例☆23Updated 7 years ago
- mml是类似于阿里云的机器学习平台☆54Updated last year
- 基于袋鼠云提供的开源flinkStreamSQL项目，对其实时sql进行可视化功能开发；通过tcpip通信，前端页面选择需要连接的数据库信息，并写sql语句，点击提交后，后端自动执行集群启动和JobGraph提交，并返回结果给前端页面。实现了使用者即使不了解Kafka、fl…☆11Updated 5 years ago
- a tool help copy files from hdfs direct to ftp server☆12Updated last year
- 手动管理spark streaming集成kafka的数据偏移量到zookeeper中☆22Updated 6 years ago
- Spark structured-streaming 消费kafka数据写入hbase☆33Updated 5 years ago
- 基于flink 1.8 源码二次开发，详见MD☆80Updated 4 years ago
- sql实现Structured Streaming☆39Updated 5 years ago
- ☆30Updated last year
- 机器学习项目☆37Updated 7 years ago
- ☆43Updated 5 years ago
- 流程化 机器学习框架 基于 scala java语言 ,一站式自动机器学习平台 ,主要包括数据分析 特征工程 ，机器模型，自动部署，超参数优化，模型自动优化，自动扩容分配创建功能，类似第四范式、阿里PAI平台、google autoMl、亚马逊SageMaker☆64Updated 6 years ago
- Spark MLlib Learning☆71Updated 7 years ago
- hbase+solr实现hbase的二级索引☆47Updated 3 years ago
- mysql数据实时增量导入hive☆87Updated 7 years ago
- ☆42Updated 6 years ago
- This is a based on playframwork for submit spark app☆60Updated last year
- A HBase datasource implementation for Spark and [MLSQL](http://www.mlsql.tech).☆13Updated last year
- Encapsulated spark 与其他组件的结合api，方便使用，例如 es，hbase，kudu，kafka，mq等☆35Updated 4 years ago
- SparkSQL自定义Hint优化器解决热点数据导致JOIN数据倾斜问题☆48Updated 5 years ago