huawei-cloudnative / sparkLinks
Apache Spark enhanced with Volcano, a Kubernetes native batch system
☆11Updated 2 years ago
Alternatives and similar repositories for spark
Users that are interested in spark are comparing it to the libraries listed below
Sorting:
- An kubernetes opterator to manager the yarn nodemanager, which can be used to deploy yarn on kubernetes.☆23Updated 4 years ago
- alibabacloud-jindodata☆195Updated this week
- The API (CRD) of Volcano☆43Updated 3 weeks ago
- A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes☆176Updated 2 years ago
- ☆37Updated 2 years ago
- Kubeflow helm chart☆143Updated last year
- hadoop on kubernetes. It contains the configuration of HDFS and Yarn☆29Updated 7 years ago
- ☆19Updated 2 years ago
- Cloud-native way to provide elastic Jupyter Notebooks on Kubernetes. Run remote kernels, natively.☆201Updated 3 years ago
- Katalyst aims to provide a universal solution to help improve resource utilization and optimize the overall costs in the cloud. This is t…☆498Updated this week
- Set of Kubernetes solutions for reusing idle resources of nodes by running extra batch jobs☆351Updated last year
- Helm chart from stable/hadoop, updated to hadoop 3.2.1☆22Updated 5 years ago
- Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆31Updated 4 years ago
- 最简单的 spark sql on kubernetes 生产环境部署方案☆18Updated 2 years ago
- Kubernetes Operator for MPI-based applications (distributed training, HPC, etc.)☆483Updated last month
- Device plugins for Volcano, e.g. GPU☆124Updated 3 months ago
- Cloud Native ML/DL Platform☆132Updated 4 years ago
- Common APIs and libraries shared by other Kubeflow operator repositories.☆52Updated 2 years ago
- ☆117Updated 2 years ago
- Kubernetes Operator for StarRocks☆161Updated 3 weeks ago
- Apache YuniKorn K8shim☆156Updated this week
- Firestorm is a Remote Shuffle Service, and provides the capability for Apache Spark and Apache Hadoop MapReduce applications to store shu…☆256Updated 2 years ago
- Cloud Shuffle Service(CSS) is a general purpose remote shuffle solution for compute engines, including Spark/Flink/MapReduce.☆257Updated last year
- Shuttle：High Available, High Performance Remote Shuffle Service☆154Updated 2 years ago
- Run your deep learning workloads on Kubernetes more easily and efficiently.☆524Updated last year
- A CLI for Kubeflow.☆60Updated last year
- An extended suite for running Hadoop YARN jobs in K8s with Koordinator.☆12Updated 3 weeks ago
- A federation scheduler for multi-cluster☆44Updated last week
- Kubernetes Operator for AI and Bigdata Elastic Training☆87Updated 5 months ago
- Fault-tolerant for DL frameworks☆70Updated last year