A command-line interface tool for serving LLM using vLLM.
☆505Jan 25, 2026Updated 9 months ago
Alternatives and similar repositories for vllm-cli
Users that are interested in vllm-cli are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A CLI tool for managing your locally downloaded Huggingface models and datasets☆36Aug 19, 2025Updated last year
- A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes…☆543Oct 16, 2026Updated 2 weeks ago
- Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs☆1,741Updated this week
- The easiest & fastest way to run LLMs in your home lab☆89Feb 23, 2026Updated 8 months ago
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆12,253Updated this week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, T…☆523Updated this week
- MMLU-Pro eval results☆15Aug 21, 2025Updated last year
- vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization☆2,705Oct 27, 2026Updated last week
- ☆39Aug 4, 2025Updated last year
- ☆2,795Jul 27, 2026Updated 3 months ago
- ☆46Feb 20, 2026Updated 8 months ago
- State of the art inference performance with modern accelerators on Kubernetes☆5,126Updated this week
- Nano vLLM☆16,253Apr 26, 2026Updated 6 months ago
- State-of-the-art LLM compression, built for production inference with vLLM☆3,937Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆51Oct 1, 2025Updated last year
- A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM☆934Updated this week
- SGLang is a high-performance serving framework for large language models and multimodal models.☆38,342Updated this week
- Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement…☆10,837Oct 26, 2026Updated last week
- ☆485Nov 25, 2025Updated 11 months ago
- The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU cluste…☆5,199Oct 26, 2026Updated last week
- Common recipes to run vLLM☆1,078Updated this week
- A pure MLX-based training pipeline for fine-tuning LLMs using GRPO on Apple Silicon.☆248Oct 28, 2025Updated last year
- The easiest way to use MiniMax H3. One compact workflow for T2V, I2V, first/last-frame, and reference video generation, with a unified mu…☆19Aug 12, 2026Updated 2 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A high-performance and light-weight router for vLLM large scale deployment☆494Updated this week
- MAESTRO is an AI-powered research application designed to streamline complex research tasks.☆1,499Apr 16, 2026Updated 6 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆96,053Updated this week
- vLLM Daily Summarization of Merged PRs☆56Updated this week
- Diagnose vLLM inference servers☆18Jul 31, 2026Updated 3 months ago
- ☆28Sep 27, 2026Updated last month
- Tiny evaluation of leading LLMs on competitive programming problems☆14Apr 10, 2026Updated 6 months ago
- A framework for efficient model inference with omni-modality models☆7,489Updated this week
- General plug-and-play inference library for Recursive Language Models (RLMs), supporting various sandboxes.☆17Apr 26, 2026Updated 6 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Renderer for the harmony response format to be used with gpt-oss☆4,539Apr 8, 2026Updated 6 months ago
- Recursive-Open-Meta-Agent v0.1 (Beta). A meta-agent framework to build high-performance multi-agent systems.☆5,190Feb 16, 2026Updated 8 months ago
- ArcticInference: vLLM plugin for high-throughput, low-latency inference☆494Sep 23, 2026Updated last month
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.☆78,910Updated this week
- 本项目旨在解决Qwen3-Reranker-0.6B模型无法通过Vllm平台直接部署的问题。☆13Jul 8, 2025Updated last year
- Cost-efficient and pluggable Infrastructure components for GenAI inference☆5,176Updated this week
- Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails…☆7,104Oct 24, 2026Updated last week