huawei-cloudnative / spark
Apache Spark enhanced with Volcano, a Kubernetes native batch system
☆11Updated 2 years ago
Alternatives and similar repositories for spark:
Users that are interested in spark are comparing it to the libraries listed below
- An kubernetes opterator to manager the yarn nodemanager, which can be used to deploy yarn on kubernetes.☆23Updated 4 years ago
- Kubeflow helm chart☆144Updated last year
- alibabacloud-jindodata☆187Updated last week
- Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆31Updated 4 years ago
- ☆36Updated 2 years ago
- Helm chart from stable/hadoop, updated to hadoop 3.2.1☆22Updated 5 years ago
- Set of Kubernetes solutions for reusing idle resources of nodes by running extra batch jobs☆348Updated last year
- ☆19Updated last year
- A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes☆176Updated 2 years ago
- The API (CRD) of Volcano☆37Updated 2 weeks ago
- Cloud Native ML/DL Platform☆133Updated 4 years ago
- hadoop on kubernetes. It contains the configuration of HDFS and Yarn☆29Updated 7 years ago
- Device plugins for Volcano, e.g. GPU☆118Updated last month
- Device-plugin for volcano vgpu which support hard resource isolation☆73Updated this week
- A CLI for Kubeflow.☆60Updated last year
- 最简单的 spark sql on kubernetes 生产环境部署方案☆18Updated last year
- ☆132Updated 4 years ago
- hadoop-cos(CosN文件系统)为Apache Hadoop、Spark以及Tez等大数据计算框架集成提供支持,可以像访问HDFS一样读写存储在腾讯云COS上的数据。同时也支持作为Druid等查询与分析引擎的Deep Storage☆85Updated this week
- HDFS & YARN jmx metrics prometheus exporter☆79Updated 8 months ago
- ☆41Updated this week
- A Cloud-Native Service Catalog and Full Lifecycle Management Platform accross Multi-cloud and Edge☆33Updated last year
- Shuttle:High Available, High Performance Remote Shuffle Service☆152Updated 2 years ago
- benchmark-for-spark☆16Updated 3 months ago
- Kubernetes Operator for AI and Bigdata Elastic Training☆85Updated 3 months ago
- Flink native Kubernetes Operator is a java based control plane for running Apache Flink native application on Kubernetes.☆52Updated 2 years ago
- Apache YuniKorn K8shim☆154Updated this week
- Helm chart: single-node, pseudo-distributed, kerberized, hadoop cluster: K8S☆19Updated 7 years ago
- Using CRDs to manage GPU resources in Kubernetes.☆199Updated 2 years ago
- Run your deep learning workloads on Kubernetes more easily and efficiently.☆520Updated last year
- Firestorm is a Remote Shuffle Service, and provides the capability for Apache Spark and Apache Hadoop MapReduce applications to store shu…☆255Updated 2 years ago