Native Windows vLLM: 0.27.1 Latest; 0.29.0 Python 3.14/CUDA 13.2 release (CPU TorchAudio), plus Python 3.13/CUDA 13.0 prerelease. PyTorch 2.13, FlashAttention/Rust, OpenAI serving, 10 KV formats, Multi-TurboQuant, experimental CPU/NVMe KV offload. No WSL or Docker.
☆64Oct 10, 2026Updated 3 weeks ago
Alternatives and similar repositories for vllm-windows-build
Users that are interested in vllm-windows-build are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A high-throughput and memory-efficient inference and serving engine for LLMs (Windows build & kernels)☆680Updated this week
- ☆15Nov 5, 2025Updated 11 months ago
- One-click Qwen3.6-27B inference on Windows. 158 tok/s on RTX 5090, 72 tok/s on RTX 3090. Native, no WSL, no Docker, no telemetry.☆231May 14, 2026Updated 5 months ago
- Unified KV-cache compression for LLM inference: 12 Python-native methods, guarded add-on composition and routing, analytical capacity sim…☆30Oct 10, 2026Updated 3 weeks ago
- An experimental node☆30Jan 13, 2026Updated 9 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ComfyUI-Unwatermark is a custom node for ComfyUI that integrates the power of unwatermark.ai to automatically detect and remove watermark…☆11May 14, 2025Updated last year
- Real-time terminal UI dashboard for monitoring vLLM☆33Jul 13, 2026Updated 3 months ago
- An open-source desktop app for generating videos with LTX models with additions for LOW VRAM and EXTRAS☆13Apr 3, 2026Updated 6 months ago
- Multi-GPU prefill acceleration for llama.cpp☆15Oct 23, 2026Updated last week
- AuditPolicy module aims to replace auditpol.exe to get or set Auditing Policies in Windows in more native PowerShell way☆11Feb 14, 2026Updated 8 months ago
- CLI port of BenchLocal quality bench packs — runs LLM behavioral evals against any OpenAI-compatible endpoint. Companion to club-3090.☆20Oct 16, 2026Updated 2 weeks ago
- Routing-aware expert paging for memory-constrained MoE serving — a vLLM plug-in with byte-identical outputs and joint expert/KV memory al…☆15Sep 15, 2026Updated last month
- OpenAI-compatible proxy for Zcode☆40Updated this week
- Flotilla is the main point of access for operators to interact with multiple robots in a facility.☆20Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- HikVision IP Camera Alarm Server to MQTT☆14Sep 20, 2023Updated 3 years ago
- React application framework on preact signals☆16Aug 14, 2023Updated 3 years ago
- A small collection of nodes intended for use with Lodestone Rock's Chroma model, for ComfyUI.☆14Jul 19, 2026Updated 3 months ago
- https://github.com/thu-ml/SageAttention☆20Nov 5, 2025Updated 11 months ago
- Voice cloning with 80+ emotions and multi-emotion mixing for ComfyUI☆26Jan 25, 2026Updated 9 months ago
- Comfyui提示词管理节点☆16Sep 16, 2026Updated last month
- Huntress API☆11May 26, 2022Updated 4 years ago
- A ComfyUI plugin specifically designed for editing 360-degree camera photos☆14Mar 8, 2026Updated 7 months ago
- ☆26Nov 1, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Proxima lets existing GPUs serve 4x more concurrent requests☆26Aug 19, 2026Updated 2 months ago
- A high-throughput LLM serving engine with non-uniform KV cache compression, built on vLLM☆16Sep 9, 2026Updated last month
- ClaraCore extends llama-swap with intelligent automation, bringing zero-configuration setup to llama.cpp deployments.☆16Jul 20, 2026Updated 3 months ago
- This patch will make dwm run "~/.dwm/autostart_blocking.sh" and "~/.dwm/autostart.sh &" before entering the handler loop.☆11Oct 2, 2012Updated 14 years ago
- Run shell commands in SQL prompt☆10Jul 11, 2024Updated 2 years ago
- ComfyUI custom nodes for detecting provenance marks, removing visible and invisible AI watermarks, stripping metadata, and erasing select…☆33Updated this week
- Pop-up LastPass desktop quick-search. Output the selection to the clipboard or have xdotool type it out for you.☆10Aug 8, 2024Updated 2 years ago
- A library for building advanced, optimised Ember.js apps☆25Updated this week
- nvtop for vLLM — an interactive terminal dashboard for vLLM serving performance (concurrency, throughput, cache & KV memory, latency, spe…☆19Jun 25, 2026Updated 4 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- 自动切换国内源的 skill，加速软件安装，UV, pip, npm, homebrew, linux, github, 清华源，阿里源，中科大源。。。☆19May 29, 2026Updated 5 months ago
- ComfyUI加载视频/图像节点，支持图像和视频大批量自动加载处理，无需for循环无需填入批量队列☆15Aug 11, 2026Updated 2 months ago
- 一个用于获取加密货币价格涨跌行情的 daemon，封装了多家交易所的API，将数据持久化在本地☆11Aug 31, 2018Updated 8 years ago
- Generic API clients based on Pydantic and protocols☆13Updated this week
- Simple validator for identification numbers based on Luhn algorithm☆15Jan 8, 2026Updated 9 months ago
- Dockerized environment to ease odoo development☆17Updated this week
- Handy scripts for Arch Linux users☆13Feb 15, 2014Updated 12 years ago