Alternatives and similar repositories for grove

Users that are interested in grove are comparing it to the libraries listed below

• NVIDIA / topograph
  A toolkit for discovering cluster network topology.
  ☆69Updated this week
• llm-d / llm-d-inference-scheduler
  Inference scheduler for llm-d
  ☆94Updated last week
• sgl-project / ome
  OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)
  ☆273Updated last week
• NVIDIA / KAI-Scheduler
  KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale
  ☆815Updated last week
• NVIDIA / k8s-nim-operator
  An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
  ☆129Updated this week
• kubernetes-sigs / gateway-api-inference-extension
  Gateway API Inference Extension
  ☆486Updated this week
• kubernetes-sigs / inference-perf
  GenAI inference performance benchmarking tool
  ☆97Updated this week
• NVIDIA / k8s-dra-driver-gpu
  NVIDIA DRA Driver for GPUs
  ☆446Updated this week
• llm-d / llm-d-inference-sim
  A light weight vLLM simulator, for mocking out replicas.
  ☆48Updated last week
• llm-d / llm-d-kv-cache-manager
  Distributed KV cache coordinator
  ☆71Updated this week
• kubernetes-sigs / lws
  LeaderWorkerSet: An API for deploying a group of pods as a unit of replication
  ☆583Updated this week
• kubernetes-sigs / jobset
  JobSet: a k8s native API for distributed ML training and HPC workloads
  ☆262Updated this week
• NVIDIA / cuda-checkpoint
  CUDA checkpoint and restore utility
  ☆371Updated last week
• IBM / autopilot
  A tool to detect infrastructure issues on cloud native AI systems
  ☆47Updated last week
• NVIDIA / mig-parted
  MIG Partition Editor for NVIDIA GPUs
  ☆213Updated 2 weeks ago
• NVIDIA / knavigator
  knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.
  ☆69Updated 2 months ago
• coreweave / nccl-tests
  NVIDIA NCCL Tests for Distributed Training
  ☆111Updated last week
• llm-d / llm-d-benchmark
  llm-d benchmark scripts and tooling
  ☆28Updated this week
• kubernetes-sigs / wg-serving
  WG Serving
  ☆30Updated 2 weeks ago
• InftyAI / llmaz
  ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
  ☆254Updated last week
• leptonai / gpud
  GPUd automates monitoring, diagnostics, and issue identification for GPUs
  ☆433Updated this week
• project-codeflare / multi-cluster-app-dispatcher
  Holistic job manager on Kubernetes
  ☆116Updated last year
• llm-d / llm-d-model-service
  Simplified model deployment on llm-d
  ☆27Updated 2 months ago
• llm-d / llm-d
  llm-d enables high-performance distributed LLM inference on Kubernetes
  ☆1,781Updated this week
• run-ai / fake-gpu-operator
  ☆144Updated last week
• sgl-project / rbg
  A workload for deploying LLM inference services on Kubernetes
  ☆43Updated this week
• fmperf-project / fmperf
  Cloud Native Benchmarking of Foundation Models
  ☆42Updated last month
• ai-dynamo / nixl
  NVIDIA Inference Xfer Library (NIXL)
  ☆633Updated this week
• run-ai / runai-model-streamer
  ☆254Updated last week
• oracle-quickstart / oci-hpc-oke
  This repo includes everything you need to know about deploying GPU nodes on OCI
  ☆35Updated last week