Alternatives and similar repositories for vllm-metal

Users that are interested in vllm-metal are comparing it to the libraries listed below

• micytao / vllm-playground
  A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes…
  ☆172Updated this week
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆45Updated this week
• vllm-project / recipes
  Common recipes to run vLLM
  ☆283Updated last week
• vllm-project / speculators
  A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM
  ☆160Updated last week
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆84Updated last month
• Chen-zexi / vllm-cli
  A command-line interface tool for serving LLM using vLLM.
  ☆456Updated 3 weeks ago
• MoonshotAI / K2-Vendor-Verifier
  Verify Precision of all Kimi K2 API Vendor
  ☆489Updated last month
• snowflakedb / ArcticInference
  ArcticInference: vLLM plugin for high-throughput, low-latency inference
  ☆354Updated this week
• huggingface / inference-benchmarker
  Inference server benchmarking tool
  ☆132Updated 2 months ago
• mani-kantap / llm-inference-solutions
  A collection of all available inference solutions for the LLMs
  ☆93Updated 9 months ago
• sgl-project / sgl-project.github.io
  This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang/tree/main/docs.
  ☆95Updated this week
• cornserve-ai / cornserve
  Easy, Fast, and Scalable Multimodal AI
  ☆81Updated this week
• wdlctc / headinfer
  ☆63Updated 7 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆162Updated 3 weeks ago
• MoonshotAI / kosong
  The LLM abstraction layer for modern AI agent applications.
  ☆496Updated this week
• deepseek-ai / LPLB
  An early research stage expert-parallel load balancer for MoE models based on linear programming.
  ☆469Updated last month
• tilde-research / MoMoE-impl
  Memory optimized Mixture of Experts
  ☆72Updated 4 months ago
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆59Updated 10 months ago
• woct0rdho / transformers-qwen3-moe-fused
  Fused Qwen3 MoE layer for faster training, compatible with HF Transformers, LoRA, 4-bit quant, Unsloth
  ☆217Updated last month
• bentoml / BentoLMDeploy
  Self-host LLMs with LMDeploy and BentoML
  ☆21Updated 5 months ago
• MoonshotAI / checkpoint-engine
  Checkpoint-engine is a simple middleware to update model weights in LLM inference engines
  ☆871Updated this week
• snowflakedb / ArcticTraining
  ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)
  ☆261Updated this week
• nyunAI / PruneGPT
  ☆51Updated last year
• snu-mllab / KVzip
  [NeurIPS'25 Oral] Query-agnostic KV cache eviction: 3–4× reduction in memory and 2× decrease in latency (Qwen3/2.5, Gemma3, LLaMA3)
  ☆169Updated 3 weeks ago
• vllm-project / dashboard
  vLLM performance dashboard
  ☆39Updated last year
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆148Updated 10 months ago
• hao-ai-lab / Dynasor
  [NeurIPS 2025] Simple extension on vLLM to help you speed up reasoning model without training.
  ☆215Updated 6 months ago
• horus-ai-labs / DistillFlow
  Library for model distillation
  ☆158Updated 3 months ago
• apple / ml-recurrent-drafter
  ☆219Updated 11 months ago
• eqimp / hogwild_llm
  Official PyTorch implementation for Hogwild! Inference: Parallel LLM Generation with a Concurrent Attention Cache
  ☆136Updated 4 months ago