palantir / k8s-spark-scheduler
A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes
☆176Updated last year
Alternatives and similar repositories for k8s-spark-scheduler:
Users that are interested in k8s-spark-scheduler are comparing it to the libraries listed below
- Operator for managing the Spark clusters on Kubernetes and OpenShift.☆158Updated 3 years ago
- Performance optimization for Spark running on Kubernetes☆87Updated 4 years ago
- Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆209Updated this week
- [DEPRECATED] Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆658Updated 2 years ago
- Kubernetes operator that provides control plane for managing Apache Flink applications☆570Updated 6 months ago
- Druid Kubernetes Operator☆206Updated 9 months ago
- Repository holding configuration files for running an HDFS cluster in Kubernetes☆397Updated 5 months ago
- Apache YuniKorn K8shim☆149Updated this week
- Secure HDFS Access from Kubernetes☆60Updated 4 years ago
- The gateway component to make Spark on K8s much easier for Spark users.☆186Updated last month
- Running YARN on Kubernetes with PetSet controller.☆166Updated 7 years ago
- An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes☆82Updated 5 years ago
- Curated Big Data Applications for Kubernetes☆100Updated last year
- Kubernetes (K8s) Operator for PrestoDB☆46Updated 3 years ago
- Spark on Kubernetes infrastructure Helm charts repo☆198Updated 2 years ago
- Apache YuniKorn Core☆903Updated this week
- Setup for running Trino with Hive Metastore on Kubernetes☆100Updated 2 years ago
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆326Updated last year
- Apache Spark enhanced with native Kubernetes scheduler back-end: NOTE this repository is being ARCHIVED as all new development for the ku…☆612Updated 5 years ago
- Kubernetes custom controller and CRDs to managing Airflow☆299Updated 4 years ago
- Common APIs and libraries shared by other Kubeflow operator repositories.☆52Updated last year
- Spark metrics related custom classes and sinks (e.g. Prometheus)☆180Updated 2 years ago
- Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange☆127Updated 3 months ago
- Kubernetes Operator for StarRocks☆151Updated this week
- Apache Spark enhanced with Volcano, a Kubernetes native batch system☆11Updated 2 years ago
- This project provides fully automated one-click experience to create Cloud and Kubernetes environment to run Data Analytics workload like…☆55Updated 2 years ago
- Airflow on Kubernetes Operator☆89Updated 2 years ago
- benchmark-for-spark☆16Updated 2 months ago
- ☆34Updated 3 years ago
- DynoYARN is a framework to run simulated YARN clusters and workloads for YARN scale testing.☆59Updated 2 years ago