palantir / k8s-spark-scheduler
A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes
☆176Updated last year
Alternatives and similar repositories for k8s-spark-scheduler:
Users that are interested in k8s-spark-scheduler are comparing it to the libraries listed below
- Performance optimization for Spark running on Kubernetes☆85Updated 4 years ago
- Operator for managing the Spark clusters on Kubernetes and OpenShift.☆157Updated 3 years ago
- Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆201Updated this week
- Repository holding configuration files for running an HDFS cluster in Kubernetes☆397Updated 3 months ago
- Apache YuniKorn K8shim☆145Updated this week
- Running YARN on Kubernetes with PetSet controller.☆165Updated 6 years ago
- Airflow on Kubernetes Operator☆89Updated last year
- [DEPRECATED] Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆657Updated 2 years ago
- Kubernetes (K8s) Operator for PrestoDB☆46Updated 3 years ago
- Kubernetes operator that provides control plane for managing Apache Flink applications☆569Updated 4 months ago
- An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes☆81Updated 4 years ago
- Secure HDFS Access from Kubernetes☆60Updated 4 years ago
- DynoYARN is a framework to run simulated YARN clusters and workloads for YARN scale testing.☆58Updated last year
- The gateway component to make Spark on K8s much easier for Spark users.☆184Updated 6 months ago
- Apache Spark enhanced with native Kubernetes scheduler back-end: NOTE this repository is being ARCHIVED as all new development for the ku…☆612Updated 5 years ago
- Setup for running Trino with Hive Metastore on Kubernetes☆99Updated 2 years ago
- Curated Big Data Applications for Kubernetes☆99Updated last year
- Kubernetes custom controller and CRDs to managing Airflow☆299Updated 4 years ago
- Spark metrics related custom classes and sinks (e.g. Prometheus)☆176Updated 2 years ago
- This project provides fully automated one-click experience to create Cloud and Kubernetes environment to run Data Analytics workload like…☆53Updated 2 years ago
- ☆112Updated 2 years ago
- benchmark-for-spark☆16Updated last week
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆327Updated last year
- Spark on Kubernetes infrastructure Helm charts repo☆200Updated 2 years ago
- Apache Spark Kubernetes Operator☆83Updated 2 weeks ago
- Apache YuniKorn Core☆882Updated this week
- Apache Spark enhanced with Volcano, a Kubernetes native batch system☆11Updated 2 years ago
- ☆34Updated 3 years ago
- Druid Kubernetes Operator☆206Updated 7 months ago