NVIDIA / knavigatorLinks
knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.
β67Updated 2 months ago
Alternatives and similar repositories for knavigator
Users that are interested in knavigator are comparing it to the libraries listed below
Sorting:
- Example DRA driver that developers can fork and modify to get them started writing their own.β77Updated 2 weeks ago
- π§― Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.β30Updated this week
- Holistic job manager on Kubernetesβ116Updated last year
- π« A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIβ¦β24Updated 7 months ago
- β117Updated 2 years ago
- A simulator of Kuberntes for batch and service workload.β47Updated 4 years ago
- Resource Exporter for volcano scheduling, e.g. NUMA-Aware scheduling.β17Updated last month
- Device plugins for Volcano, e.g. GPUβ125Updated 3 months ago
- β62Updated last week
- β124Updated this week
- Go Abstraction for Allocating NVIDIA GPUs with Custom Policiesβ114Updated last week
- JobSet: a k8s native API for distributed ML training and HPC workloadsβ241Updated last week
- ControllerMesh is a solution that helps developers manage their controllers/operators better with enhanced isolation.β64Updated 2 years ago
- Kubernetes Container Runtime Interface proxy service with hardware resource aware workload placement policiesβ179Updated 2 months ago
- Load watcher is a cluster-wide aggregator of metrics, developed for Trimaran: Real Load Aware Scheduler in Kubernetes.β76Updated 6 months ago
- [Moved to https://github.com/kubernetes-sigs/kwok] This is a fake kubelet. that can simulate any number of nodes and maintain pods on thoβ¦β64Updated 2 years ago
- Device-plugin for volcano vgpu which support hard resource isolationβ92Updated last week
- GenAI inference performance benchmarking toolβ64Updated this week
- A Cloud-Native Service Catalog and Full Lifecycle Management Platform accross Multi-cloud and Edgeβ34Updated last year
- katalyst aims to provide a universal solution to help improve resource utilization and optimize the overall costs in the cloud. This repoβ¦β46Updated last week
- A collection of community maintained NRI pluginsβ85Updated last week
- The API (CRD) of Volcanoβ43Updated 2 weeks ago
- An OCM addon that automates the installation of Kubernetes' konnectivity servers and agents.β48Updated 2 months ago
- NVIDIA device plugin for Kubernetesβ15Updated 5 years ago
- βΈοΈ Easy, advanced inference platform for large language models on Kubernetes. π Star to support our work!β219Updated this week
- Inference scheduler for llm-dβ61Updated this week
- Gateway API Inference Extensionβ373Updated this week
- elastic-gpu-scheduler is a Kubernetes scheduler extender for GPU resources scheduling.β141Updated 2 years ago
- Libraries for implementing aggregated apiserversβ91Updated 2 months ago
- Node Resource Interfaceβ309Updated this week