huawei-cloudnative / sparkLinks
Apache Spark enhanced with Volcano, a Kubernetes native batch system
☆11Updated 2 years ago
Alternatives and similar repositories for spark
Users that are interested in spark are comparing it to the libraries listed below
Sorting:
- alibabacloud-jindodata☆199Updated this week
- Cloud Native ML/DL Platform☆133Updated 5 years ago
- Kubeflow helm chart☆145Updated 2 years ago
- An kubernetes opterator to manager the yarn nodemanager, which can be used to deploy yarn on kubernetes.☆22Updated 4 years ago
- ☆37Updated 2 years ago
- A CLI for Kubeflow.☆60Updated last year
- A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes☆176Updated 2 years ago
- Run your deep learning workloads on Kubernetes more easily and efficiently.☆531Updated last year
- ☆19Updated 2 years ago
- The API (CRD) of Volcano☆45Updated last week
- 最简单的 spark sql on kubernetes 生产环境部署方案☆18Updated 2 years ago
- Set of Kubernetes solutions for reusing idle resources of nodes by running extra batch jobs☆355Updated 3 months ago
- An operator for managing Alluxio system on Kubernetes cluster☆13Updated last year
- A CLI for Kubeflow.☆797Updated last week
- Firestorm is a Remote Shuffle Service, and provides the capability for Apache Spark and Apache Hadoop MapReduce applications to store shu …☆257Updated 2 years ago
- Cloud Native Machine Learning Model Registry☆82Updated 2 years ago
- Apache YuniKorn Core☆977Updated 2 weeks ago
- Cloud Shuffle Service(CSS) is a general purpose remote shuffle solution for compute engines, including Spark/Flink/MapReduce.☆261Updated last year
- Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆32Updated 5 years ago
- Helm chart from stable/hadoop, updated to hadoop 3.2.1☆23Updated 5 years ago
- Device plugins for Volcano, e.g. GPU☆129Updated 6 months ago
- Kubernetes Operator for AI and Bigdata Elastic Training☆88Updated 9 months ago
- benchmark-for-spark☆16Updated 5 months ago
- Kubernetes Operator for MPI-based applications (distributed training, HPC, etc.)☆496Updated 2 weeks ago
- Cloud-native way to provide elastic Jupyter Notebooks on Kubernetes. Run remote kernels, natively.☆203Updated 3 years ago
- Shuttle：High Available, High Performance Remote Shuffle Service☆156Updated 2 years ago
- ☆42Updated 2 weeks ago
- hadoop on kubernetes. It contains the configuration of HDFS and Yarn☆30Updated 7 years ago
- [DEPRECATED] Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆658Updated 3 years ago
- Using CRDs to manage GPU resources in Kubernetes.☆209Updated 2 years ago