ai-dynamo / groveLinks
Kubernetes enhancements for Network Topology Aware Gang Scheduling & Autoscaling
☆82Updated this week
Alternatives and similar repositories for grove
Users that are interested in grove are comparing it to the libraries listed below
Sorting:
- A toolkit for discovering cluster network topology.☆74Updated this week
- KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale☆869Updated this week
- NVIDIA DRA Driver for GPUs☆464Updated this week
- Gateway API Inference Extension☆501Updated this week
- Inference scheduler for llm-d☆99Updated last week
- OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)☆298Updated this week
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆130Updated last week
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆601Updated last week
- JobSet: a k8s native API for distributed ML training and HPC workloads☆268Updated last week
- GenAI inference performance benchmarking tool☆106Updated last week
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆261Updated 2 weeks ago
- MIG Partition Editor for NVIDIA GPUs☆219Updated this week
- ☆152Updated last week
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆70Updated 3 months ago
- A light weight vLLM simulator, for mocking out replicas.☆52Updated this week
- NVIDIA NCCL Tests for Distributed Training☆116Updated this week
- CUDA checkpoint and restore utility☆377Updated last month
- Holistic job manager on Kubernetes☆116Updated last year
- llm-d helm charts and deployment examples☆45Updated 3 weeks ago
- GPUd automates monitoring, diagnostics, and issue identification for GPUs