palantir / k8s-spark-scheduler
A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes
☆176Updated last year
Related projects ⓘ
Alternatives and complementary repositories for k8s-spark-scheduler
- Performance optimization for Spark running on Kubernetes☆85Updated 4 years ago
- Operator for managing the Spark clusters on Kubernetes and OpenShift.☆157Updated 3 years ago
- Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆195Updated 2 months ago
- Apache YuniKorn K8shim☆143Updated this week
- Kubernetes (K8s) Operator for PrestoDB☆46Updated 3 years ago
- Repository holding configuration files for running an HDFS cluster in Kubernetes☆398Updated last month
- Secure HDFS Access from Kubernetes☆60Updated 4 years ago
- Kubernetes operator that provides control plane for managing Apache Flink applications☆569Updated 2 months ago
- benchmark-for-spark☆16Updated 2 weeks ago
- [DEPRECATED] Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆659Updated 2 years ago
- Common APIs and libraries shared by other Kubeflow operator repositories.☆51Updated last year
- Apache Spark Kubernetes Operator☆65Updated last week
- Setup for running Trino with Hive Metastore on Kubernetes☆98Updated 2 years ago
- Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange☆127Updated last month
- Running YARN on Kubernetes with PetSet controller.☆166Updated 6 years ago
- ☆34Updated 3 years ago
- Apache YuniKorn Core☆865Updated this week
- Spark on Kubernetes infrastructure Helm charts repo☆199Updated 2 years ago
- ☆35Updated 2 years ago
- An kubernetes opterator to manager the yarn nodemanager, which can be used to deploy yarn on kubernetes.☆22Updated 3 years ago
- The gateway component to make Spark on K8s much easier for Spark users.☆181Updated 4 months ago
- Kubernetes Operator for StarRocks☆137Updated last week
- Cloud-native way to provide elastic Jupyter Notebooks on Kubernetes. Run remote kernels, natively.☆197Updated 2 years ago
- Spark metrics related custom classes and sinks (e.g. Prometheus)☆176Updated 2 years ago
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆323Updated last year
- An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes☆81Updated 4 years ago
- This project provides fully automated one-click experience to create Cloud and Kubernetes environment to run Data Analytics workload like…☆53Updated last year
- ☆109Updated 2 years ago
- DynoYARN is a framework to run simulated YARN clusters and workloads for YARN scale testing.☆58Updated last year