NVIDIA / knavigatorLinks
knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.
β72Updated 4 months ago
Alternatives and similar repositories for knavigator
Users that are interested in knavigator are comparing it to the libraries listed below
Sorting:
- Holistic job manager on Kubernetesβ115Updated last year
- π§― Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.β33Updated last week
- Example DRA driver that developers can fork and modify to get them started writing their own.β109Updated last month
- β122Updated 3 years ago
- Resource Exporter for volcano scheduling, e.g. NUMA-Aware scheduling.β18Updated 6 months ago
- Device-plugin for volcano vgpu which support hard resource isolationβ131Updated 2 months ago
- A simulator of Kuberntes for batch and service workload.β50Updated 4 years ago
- π« A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIβ¦β24Updated 11 months ago
- elastic-gpu-scheduler is a Kubernetes scheduler extender for GPU resources scheduling.β144Updated 3 years ago
- β71Updated this week
- Device plugins for Volcano, e.g. GPUβ129Updated 8 months ago
- Go Abstraction for Allocating NVIDIA GPUs with Custom Policiesβ119Updated last week
- β69Updated this week
- JobSet: a k8s native API for distributed ML training and HPC workloadsβ282Updated last week
- β168Updated last month
- GenAI inference performance benchmarking toolβ133Updated this week
- Inference scheduler for llm-dβ106Updated this week
- A federation scheduler for multi-clusterβ58Updated 3 weeks ago
- Kubernetes Container Runtime Interface proxy service with hardware resource aware workload placement policiesβ178Updated 4 months ago
- [Moved to https://github.com/kubernetes-sigs/kwok] This is a fake kubelet. that can simulate any number of nodes and maintain pods on thoβ¦β65Updated 3 years ago
- Load watcher is a cluster-wide aggregator of metrics, developed for Trimaran: Real Load Aware Scheduler in Kubernetes.β77Updated 11 months ago
- βΈοΈ Easy, advanced inference platform for large language models on Kubernetes. π Star to support our work!β270Updated last week
- Command-line tools for managing OCI model artifacts, which are bundled based on Model Specβ50Updated last week
- katalyst aims to provide a universal solution to help improve resource utilization and optimize the overall costs in the cloud. This repoβ¦β51Updated last week
- NVIDIA Network Operatorβ301Updated this week
- Distributed KV cache coordinatorβ88Updated this week
- β268Updated this week
- A collection of community maintained NRI pluginsβ97Updated last week
- elastic-gpu-agent is a Kubernetes device plugin for GPU resources allocation on node.β55Updated 3 years ago
- Enabling Kubernetes to make pod placement decisions with platform intelligence.β176Updated 10 months ago