A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes, with special optimizations for macOS Apple Silicon and enterprise deployment on OpenShift/Kubernetes.
☆543Oct 16, 2026Updated 2 weeks ago
Alternatives and similar repositories for vllm-playground
Users that are interested in vllm-playground are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆10Nov 26, 2025Updated 11 months ago
- Enable RHOAI User Workload Metrics for Single Serving Models☆10Oct 14, 2026Updated 2 weeks ago
- Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs☆1,741Updated this week
- Guide for installing and testing RHOAI Models as a Service in Red Hat AI☆21Oct 22, 2026Updated last week
- A command-line interface tool for serving LLM using vLLM.☆505Jan 25, 2026Updated 9 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- AIOps for Distributed Environments☆18Updated this week
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆12,253Updated this week
- State-of-the-art LLM compression, built for production inference with vLLM☆3,937Updated this week
- A high-performance and light-weight router for vLLM large scale deployment☆494Updated this week
- Collection of demos for building Llama Stack based apps on OpenShift☆64Oct 24, 2026Updated last week
- A framework for efficient model inference with omni-modality models☆7,489Updated this week
- A command line tool that draw plots on the terminal.☆10Jul 16, 2026Updated 3 months ago
- State of the art inference performance with modern accelerators on Kubernetes☆5,126Updated this week
- ☆18Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- SGLang is a high-performance serving framework for large language models and multimodal models.☆38,342Updated this week
- Sardeenz is a proof-of-concept application that allows you to load more than one model on a given GPU. It allows you to add more and more…☆65Aug 14, 2026Updated 2 months ago
- vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization☆2,705Oct 27, 2026Updated last week
- AI Helpers — collections of Skills, Hooks, Agents (compatible with Claude Code, Cursor and other tools) and Gemini Gems☆39Oct 26, 2026Updated last week
- LiteMaaS is a proof-of-concept application for managing LLM subscriptions, API keys, and usage tracking. It seamlessly integrates with Li…☆79Aug 12, 2026Updated 2 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆96,053Updated this week
- CUDA-only Triton W8A8 block-FP8 kernel tuner for vLLM, with Qwen3 shape detection, custom shapes, and multi-GPU tuning.☆18Oct 7, 2026Updated 3 weeks ago
- An open, programmable decision layer for models and compute.☆6,360Updated this week
- Cost-efficient and pluggable Infrastructure components for GenAI inference☆5,176Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆10Feb 22, 2022Updated 4 years ago
- Community maintained hardware plugin for vLLM on Apple Silicon☆1,946Updated this week
- Common recipes to run vLLM☆1,078Updated this week
- Nano vLLM☆16,253Apr 26, 2026Updated 6 months ago
- Apache Airflow DAG examples☆12Oct 25, 2026Updated last week
- Control panel for VLLM, Sglang, llama.cpp, exllamav3☆1,838Oct 26, 2026Updated last week
- AI Gateway☆38Updated this week
- ☆18Mar 28, 2026Updated 7 months ago
- NVIDIA Nemotron 3.5 Lightning 30B-A3B NVFP4 + DSpark for DGX Spark, RTX 5090/6000 PRO (SGLang)☆23Aug 11, 2026Updated 2 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A Datacenter Scale Distributed Inference Serving Framework☆8,425Updated this week
- LLMRouter: An Open-Source Library for LLM Routing☆3,050Oct 19, 2026Updated 2 weeks ago
- ODH Tools & Extensions Companion☆31Feb 8, 2026Updated 8 months ago
- Real-time hardware and LLM inference monitoring — GPU, CPU, memory, and vLLM metrics streamed to a dashboard.☆139Oct 17, 2026Updated 2 weeks ago
- A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.☆5,498May 17, 2026Updated 5 months ago
- A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative…☆5,488Updated this week
- TokenSpeed is a speed-of-light LLM inference engine.☆2,841Updated this week