Alternatives and similar repositories for SPEAR

Users that are interested in SPEAR are comparing it to the libraries listed below

• llm-d / llm-d-inference-sim
  A light weight vLLM simulator, for mocking out replicas.
  ☆85Updated this week
• llm-d / llm-d-inference-scheduler
  Inference scheduler for llm-d
  ☆124Updated last week
• llm-d / llm-d-kv-cache
  Distributed KV cache scheduling & offloading libraries
  ☆101Updated this week
• copilot-io / runtime-copilot
  The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…
  ☆12Updated 2 years ago
• NVIDIA / topograph
  A toolkit for discovering cluster network topology.
  ☆96Updated last week
• ovg-project / kvcached
  Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
  ☆773Updated this week
• GPUprobe / gpuprobe-daemon
  Lightweight daemon for monitoring CUDA runtime API calls with eBPF uprobes
  ☆146Updated 10 months ago
• NVIDIA / knavigator
  knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.
  ☆74Updated 6 months ago
• fmperf-project / fmperf
  Cloud Native Benchmarking of Foundation Models
  ☆45Updated 6 months ago
• InftyAI / Awesome-LLMOps
  🎉 An awesome & curated list of best LLMOps tools.
  ☆190Updated this week
• BaizeAI / kcover
  🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.
  ☆35Updated this week
• sgl-project / rbg
  A workload for deploying LLM inference services on Kubernetes
  ☆168Updated last week
• modelpack / modctl
  Command-line tools for managing OCI model artifacts, which are bundled based on Model Spec
  ☆61Updated this week
• llm-d / llm-d-benchmark
  llm-d benchmark scripts and tooling
  ☆44Updated this week
• modelpack / model-spec
  Cloud Native Artifacial Intelligence Model Format Specification
  ☆175Updated last week
• volcano-sh / kthena
  Kubernetes-native AI serving platform for scalable model serving.
  ☆198Updated last week
• llm-d-incubation / llm-d-infra
  llm-d helm charts and deployment examples
  ☆48Updated last month
• checkpoint-restore / criu-coordinator
  A tool for coordinated checkpoint/restore of distributed applications with CRIU
  ☆31Updated 5 months ago
• intel / memtierd
  ☆38Updated 3 months ago
• sgl-project / ome
  Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, T…
  ☆365Updated this week
• volcengine / veTurboIO
  A library developed by Volcano Engine for high-performance reading and writing of PyTorch model files.
  ☆25Updated last year
• NVIDIA / k8s-kata-manager
  ☆24Updated last week
• NVIDIA / k8s-nim-operator
  An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
  ☆146Updated this week
• xlab-uiuc / acto
  Push-Button End-to-End Testing of Kubernetes Operators and Controllers
  ☆130Updated last month
• intel / cri-resource-manager
  Kubernetes Container Runtime Interface proxy service with hardware resource aware workload placement policies
  ☆178Updated 6 months ago
• ai-dynamo / modelexpress
  Model Express is a Rust-based component meant to be placed next to existing model inference systems to speed up their startup times and i…
  ☆25Updated this week
• IBM / autopilot
  A tool to detect infrastructure issues on cloud native AI systems
  ☆52Updated 4 months ago
• LMCache / LMBenchmark
  Systematic and comprehensive benchmarks for LLM systems.
  ☆50Updated last week
• AI-Hypercomputer / inference-benchmark
  ☆17Updated 7 months ago
• ai-dynamo / aiconfigurator
  Offline optimization of your disaggregated Dynamo graph
  ☆177Updated last week