palantir / k8s-spark-schedulerLinks
A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes
☆176Updated 2 years ago
Alternatives and similar repositories for k8s-spark-scheduler
Users that are interested in k8s-spark-scheduler are comparing it to the libraries listed below
Sorting:
- Apache YuniKorn K8shim☆162Updated last week
- Operator for managing the Spark clusters on Kubernetes and OpenShift.☆158Updated 4 years ago
- Apache YuniKorn Core☆995Updated this week
- Repository holding configuration files for running an HDFS cluster in Kubernetes☆398Updated last year
- [DEPRECATED] Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆657Updated 3 years ago
- Kubernetes operator that provides control plane for managing Apache Flink applications☆582Updated 5 months ago
- Performance optimization for Spark running on Kubernetes☆89Updated 5 years ago
- Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.☆223Updated last month
- Apache YuniKorn Scheduler Interface☆32Updated 3 weeks ago
- Running YARN on Kubernetes with PetSet controller.☆166Updated 7 years ago
- Secure HDFS Access from Kubernetes☆61Updated 5 years ago
- The gateway component to make Spark on K8s much easier for Spark users.☆208Updated 3 weeks ago
- benchmark-for-spark☆16Updated 8 months ago
- Curated Big Data Applications for Kubernetes☆106Updated 2 years ago
- Kubernetes (K8s) Operator for PrestoDB☆46Updated 4 years ago
- ☆37Updated 3 years ago
- Apache Spark enhanced with native Kubernetes scheduler back-end: NOTE this repository is being ARCHIVED as all new development for the ku…☆613Updated 6 years ago
- Common APIs and libraries shared by other Kubeflow operator repositories.☆53Updated 2 years ago
- A batch scheduler of kubernetes for high performance workload, e.g. AI/ML, BigData, HPC☆1,091Updated 2 years ago
- Kubernetes custom controller and CRDs to managing Airflow☆299Updated 5 years ago
- ☆34Updated 4 years ago
- Airflow on Kubernetes Operator☆87Updated 2 years ago
- Kernel for Kubeflow in Jupyter Notebook☆65Updated 6 years ago
- An kubernetes opterator to manager the yarn nodemanager, which can be used to deploy yarn on kubernetes.☆22Updated 5 years ago
- DynoYARN is a framework to run simulated YARN clusters and workloads for YARN scale testing.☆60Updated 2 years ago
- This project provides fully automated one-click experience to create Cloud and Kubernetes environment to run Data Analytics workload like…☆56Updated 3 years ago
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆336Updated 2 years ago
- Kubernetes Operator for MPI-based applications (distributed training, HPC, etc.)☆504Updated 2 weeks ago
- The serverless framework purpose-built for event streaming applications.☆224Updated last month
- An Integrated and collaborative cloud environment for building and running Spark applications on PKS/Kubernetes☆84Updated 5 years ago