palantir / k8s-spark-scheduler
A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes
☆176Updated last year
Alternatives and similar repositories for k8s-spark-scheduler:
Users that are interested in k8s-spark-scheduler are comparing it to the libraries listed below
- Performance optimization for Spark running on Kubernetes☆86Updated 4 years ago
- Apache YuniKorn K8shim☆147Updated last week
- Secure HDFS Access from Kubernetes☆60Updated 4 years ago
- Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆206Updated this week
- Kubernetes (K8s) Operator for PrestoDB☆46Updated 3 years ago
- Apache YuniKorn Core☆889Updated this week
- Kubernetes operator that provides control plane for managing Apache Flink applications☆571Updated 5 months ago
- [DEPRECATED] Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆657Updated 2 years ago
- Apache YuniKorn Scheduler Interface☆27Updated 3 weeks ago
- Common APIs and libraries shared by other Kubeflow operator repositories.☆51Updated last year
- Operator for managing the Spark clusters on Kubernetes and OpenShift.☆157Updated 3 years ago
- This project provides fully automated one-click experience to create Cloud and Kubernetes environment to run Data Analytics workload like…☆53Updated 2 years ago
- Kubernetes custom controller and CRDs to managing Airflow☆299Updated 4 years ago
- Setup for running Trino with Hive Metastore on Kubernetes☆99Updated 2 years ago
- ☆113Updated 2 years ago
- An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes☆82Updated 4 years ago
- Running YARN on Kubernetes with PetSet controller.☆165Updated 6 years ago
- DynoYARN is a framework to run simulated YARN clusters and workloads for YARN scale testing.☆58Updated last year
- Repository holding configuration files for running an HDFS cluster in Kubernetes☆397Updated 4 months ago
- ☆34Updated 3 years ago
- benchmark-for-spark☆16Updated last month
- Airflow on Kubernetes Operator☆89Updated 2 years ago
- An kubernetes opterator to manager the yarn nodemanager, which can be used to deploy yarn on kubernetes.☆22Updated 4 years ago
- ☆36Updated 2 years ago
- Set of Kubernetes solutions for reusing idle resources of nodes by running extra batch jobs☆348Updated 10 months ago
- Apache YuniKorn Release☆35Updated last week
- The gateway component to make Spark on K8s much easier for Spark users.☆184Updated 3 weeks ago
- Kubernetes Operator for MPI-based applications (distributed training, HPC, etc.)☆458Updated last month
- Apache Spark Kubernetes Operator☆94Updated this week
- Curated Big Data Applications for Kubernetes☆99Updated last year