palantir / k8s-spark-scheduler
A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes
☆176Updated last year
Alternatives and similar repositories for k8s-spark-scheduler:
Users that are interested in k8s-spark-scheduler are comparing it to the libraries listed below
- Performance optimization for Spark running on Kubernetes☆87Updated 4 years ago
- Operator for managing the Spark clusters on Kubernetes and OpenShift.☆158Updated 3 years ago
- [DEPRECATED] Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆658Updated 2 years ago
- Secure HDFS Access from Kubernetes☆60Updated 4 years ago
- Apache YuniKorn K8shim☆152Updated last week
- Kubernetes operator that provides control plane for managing Apache Flink applications☆570Updated 7 months ago
- Kubernetes (K8s) Operator for PrestoDB☆46Updated 3 years ago
- Common APIs and libraries shared by other Kubeflow operator repositories.☆52Updated last year
- Repository holding configuration files for running an HDFS cluster in Kubernetes☆396Updated 6 months ago
- Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆211Updated last week
- Setup for running Trino with Hive Metastore on Kubernetes☆101Updated 2 years ago
- Running YARN on Kubernetes with PetSet controller.☆166Updated 7 years ago
- benchmark-for-spark☆16Updated 3 months ago
- An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes☆83Updated 5 years ago
- Airflow on Kubernetes Operator☆89Updated 2 years ago
- Kubernetes custom controller and CRDs to managing Airflow☆299Updated 4 years ago
- Spark on Kubernetes infrastructure Helm charts repo☆199Updated 2 years ago
- This project provides fully automated one-click experience to create Cloud and Kubernetes environment to run Data Analytics workload like…☆55Updated 2 years ago
- The gateway component to make Spark on K8s much easier for Spark users.☆187Updated 2 months ago
- Apache Spark enhanced with native Kubernetes scheduler back-end: NOTE this repository is being ARCHIVED as all new development for the ku…☆612Updated 5 years ago
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆326Updated last year
- Apache YuniKorn Core☆913Updated 2 weeks ago
- Collection of Kubernetes Operators built with KUDO.☆229Updated 3 years ago
- ☆114Updated 2 years ago
- ☆34Updated 4 years ago
- ☆36Updated 2 years ago
- An kubernetes opterator to manager the yarn nodemanager, which can be used to deploy yarn on kubernetes.☆23Updated 4 years ago
- Apache YuniKorn Scheduler Interface☆28Updated 3 weeks ago
- Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange☆127Updated 3 months ago
- Cloud-native way to provide elastic Jupyter Notebooks on Kubernetes. Run remote kernels, natively.☆196Updated 3 years ago