huawei-cloudnative / spark
Apache Spark enhanced with Volcano, a Kubernetes native batch system
☆11Updated 2 years ago
Alternatives and similar repositories for spark
Users that are interested in spark are comparing it to the libraries listed below
Sorting:
- ☆36Updated 2 years ago
- alibabacloud-jindodata☆189Updated this week
- An kubernetes opterator to manager the yarn nodemanager, which can be used to deploy yarn on kubernetes.☆23Updated 4 years ago
- Kubeflow helm chart☆144Updated last year
- Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆31Updated 4 years ago
- 最简单的 spark sql on kubernetes 生产环境部署方案☆18Updated last year
- A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes☆176Updated 2 years ago
- Set of Kubernetes solutions for reusing idle resources of nodes by running extra batch jobs☆350Updated last year
- Firestorm is a Remote Shuffle Service, and provides the capability for Apache Spark and Apache Hadoop MapReduce applications to store shu…☆256Updated 2 years ago
- Kubernetes Operator for StarRocks☆156Updated this week
- Helm chart from stable/hadoop, updated to hadoop 3.2.1☆22Updated 5 years ago
- Device plugins for Volcano, e.g. GPU☆119Updated last month
- hadoop on kubernetes. It contains the configuration of HDFS and Yarn☆29Updated 7 years ago
- Flink native Kubernetes Operator is a java based control plane for running Apache Flink native application on Kubernetes.☆52Updated 2 years ago
- A CLI for Kubeflow.☆60Updated last year
- Cloud Native ML/DL Platform☆132Updated 4 years ago
- The API (CRD) of Volcano☆39Updated 3 weeks ago
- ☆41Updated 2 weeks ago
- Apache DolphinScheduler Kubernetes Operator.☆28Updated last year
- Run your deep learning workloads on Kubernetes more easily and efficiently.☆521Updated last year
- Katalyst aims to provide a universal solution to help improve resource utilization and optimize the overall costs in the cloud. This is t…☆486Updated last week
- Kubernetes Operator for AI and Bigdata Elastic Training☆85Updated 4 months ago
- Helm chart for Apache Hadoop using multi-arch docker images☆19Updated 3 years ago
- Cloud Shuffle Service(CSS) is a general purpose remote shuffle solution for compute engines, including Spark/Flink/MapReduce.☆255Updated last year
- ☆19Updated last year
- Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange☆127Updated 4 months ago
- Remote Shuffle Service for Flink☆190Updated 2 years ago
- Doris kubernetes operator☆108Updated this week
- Device-plugin for volcano vgpu which support hard resource isolation☆74Updated this week
- ☆115Updated 2 years ago