ai-dynamo / groveLinks
Kubernetes enhancements for Network Topology Aware Gang Scheduling & Autoscaling
☆110Updated this week
Alternatives and similar repositories for grove
Users that are interested in grove are comparing it to the libraries listed below
Sorting:
- A toolkit for discovering cluster network topology.☆81Updated this week
- GenAI inference performance benchmarking tool☆123Updated this week
- Gateway API Inference Extension☆524Updated this week
- OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)☆312Updated this week
- NVIDIA DRA Driver for GPUs☆477Updated last week
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆134Updated last week
- Inference scheduler for llm-d☆103Updated this week
- KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale☆927Updated this week
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆611Updated last week
- JobSet: a k8s native API for distributed ML training and HPC workloads☆279Updated this week
- A tool to detect infrastructure issues on cloud native AI systems☆51Updated 2 months ago
- Distributed KV cache coordinator☆85Updated this week
- ☆162Updated 3 weeks ago
- GPUd automates monitoring, diagnostics, and issue identification for GPUs☆450Updated last week
- NVIDIA NCCL Tests for Distributed Training☆123Updated this week
- MIG Partition Editor for NVIDIA GPUs☆227Updated this week
- CUDA checkpoint and restore utility☆384Updated 2 months ago
- Holistic job manager on Kubernetes☆116Updated last year
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆267Updated last week
- llm-d helm charts and deployment examples☆46Updated last month
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆71Updated 3 months ago
- Cloud Native Benchmarking of Foundation Models☆44Updated 3 months ago
- A light weight vLLM simulator, for mocking out replicas.☆57Updated this week
- Example DRA driver that developers can fork and modify to get them started writing their own.☆105Updated 2 weeks ago
- llm-d benchmark scripts and tooling☆33Updated this week
- NVIDIA Inference Xfer Library (NIXL)☆712Updated last week
- Run cloud native workloads on NVIDIA GPUs☆205Updated last month
- A workload for deploying LLM inference services on Kubernetes☆105Updated this week
- Simplified model deployment on llm-d☆27Updated 4 months ago
- Distributed Model Serving Framework☆178Updated last month