ai-dynamo / groveLinks
Kubernetes enhancements for Network Topology Aware Gang Scheduling & Autoscaling
☆119Updated this week
Alternatives and similar repositories for grove
Users that are interested in grove are comparing it to the libraries listed below
Sorting:
- A toolkit for discovering cluster network topology.☆84Updated last week
- NVIDIA DRA Driver for GPUs☆497Updated last week
- KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale☆956Updated this week
- Gateway API Inference Extension☆537Updated this week
- Inference scheduler for llm-d☆109Updated this week
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆620Updated this week
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆140Updated this week
- OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)☆324Updated this week
- GenAI inference performance benchmarking tool☆134Updated this week
- JobSet: a k8s native API for distributed ML training and HPC workloads☆286Updated this week
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆273Updated 2 weeks ago
- ☆172Updated this week
- MIG Partition Editor for NVIDIA GPUs☆231Updated this week
- CUDA checkpoint and restore utility☆395Updated 2 months ago
- GPUd automates monitoring, diagnostics, and issue identification for GPUs☆456Updated last week
- NVIDIA NCCL Tests for Distributed Training☆129Updated 3 weeks ago
- Distributed KV cache coordinator☆91Updated this week
- A light weight vLLM simulator, for mocking out replicas.☆59Updated this week
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆72Updated 4 months ago
- Example DRA driver that developers can fork and modify to get them started writing their own.☆109Updated last month
- llm-d helm charts and deployment examples☆47Updated 2 weeks ago
- A workload for deploying LLM inference services on Kubernetes☆123Updated this week
- Helm charts for llm-d☆50Updated 4 months ago
- Simplified model deployment on llm-d☆27Updated 5 months ago
- Holistic job manager on Kubernetes☆115Updated last year
- Model Registry provides a single pane of glass for ML model developers to index and manage models, versions, and ML artifacts metadata. I…☆154Updated last week
- A tool to detect infrastructure issues on cloud native AI systems☆52Updated 2 months ago
- Practical GPU Sharing Without Memory Size Constraints☆294Updated 8 months ago
- NVIDIA Inference Xfer Library (NIXL)☆740Updated this week
- Run Slurm on Kubernetes. A Slinky project.☆198Updated this week