huawei-cloudnative / spark
Apache Spark enhanced with Volcano, a Kubernetes native batch system
☆11Updated 2 years ago
Alternatives and similar repositories for spark:
Users that are interested in spark are comparing it to the libraries listed below
- alibabacloud-jindodata☆184Updated last week
- Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆31Updated 4 years ago
- ☆36Updated 2 years ago
- Helm chart from stable/hadoop, updated to hadoop 3.2.1☆22Updated 5 years ago
- Kubeflow helm chart☆143Updated last year
- An kubernetes opterator to manager the yarn nodemanager, which can be used to deploy yarn on kubernetes.☆22Updated 4 years ago
- 最简单的 spark sql on kubernetes 生产环境部署方案☆18Updated last year
- ☆19Updated last year
- A CLI for Kubeflow.☆59Updated last year
- The API (CRD) of Volcano☆37Updated 2 weeks ago
- Helm chart: single-node, pseudo-distributed, kerberized, hadoop cluster: K8S☆19Updated 7 years ago
- benchmark-for-spark☆16Updated last month
- A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes☆176Updated last year
- Set of Kubernetes solutions for reusing idle resources of nodes by running extra batch jobs☆348Updated 11 months ago
- hadoop on kubernetes. It contains the configuration of HDFS and Yarn☆29Updated 6 years ago
- Cloud Native ML/DL Platform☆132Updated 4 years ago
- Kubernetes Operator for AI and Bigdata Elastic Training☆85Updated last month
- ☆113Updated 2 years ago
- Device plugins for Volcano, e.g. GPU☆115Updated 5 months ago
- Doris kubernetes operator☆101Updated this week
- Firestorm is a Remote Shuffle Service, and provides the capability for Apache Spark and Apache Hadoop MapReduce applications to store shu…☆255Updated last year
- Cloud Native Machine Learning Model Registry☆81Updated 2 years ago
- Kubernetes Operator for StarRocks☆146Updated last week
- An operator for managing Alluxio system on Kubernetes cluster☆11Updated last year
- Device-plugin for volcano vgpu which support hard resource isolation☆62Updated last week
- ☆29Updated 5 months ago
- ☆41Updated this week
- Pafka is originated from the OpenAIOS project to leverage an optimized tiered storage access strategy to improve overall performance for …☆67Updated 3 years ago
- Flink native Kubernetes Operator is a java based control plane for running Apache Flink native application on Kubernetes.☆53Updated 2 years ago
- Apache YuniKorn K8shim☆148Updated last week