Patched native-Windows build of vLLM. Three Windows-specific fixes (CPU-relay for Gloo, Qwen3 reasoning parser, wildcard model name) on top of SystemPanic 0.19.0. Engine for devnen/qwen3.6-windows-server.
☆28May 8, 2026Updated 6 months ago
Alternatives and similar repositories for vllm-windows
Users that are interested in vllm-windows are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- One-click Qwen3.6-27B inference on Windows. 158 tok/s on RTX 5090, 72 tok/s on RTX 3090. Native, no WSL, no Docker, no telemetry.☆230May 14, 2026Updated 6 months ago
- Official repo for ChatGPT On Cozmo the little robot developed by Anki☆13Nov 14, 2024Updated 2 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs (Windows build & kernels)☆687Nov 6, 2026Updated last week
- ☆11Apr 26, 2026Updated 6 months ago
- The installation of the InsightFace package on a Windows environment, including the necessary dependencies and configurations.☆17Sep 10, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 可插拔的中文实时语音数字人/赛博女友:说话→听懂→思考→回话→口型视频,全程实时,四模块任意替换☆22Aug 22, 2026Updated 2 months ago
- Solves ComfyUI's inherent RAM bottleneck where videos are converted to uncompressed 32-bit float tensors (~24MB per frame for 1080p), cau…☆15Jan 8, 2026Updated 10 months ago
- ☆16Oct 31, 2026Updated 2 weeks ago
- Nunchaku FLUX LoRA Stacker with dynamic UI control and various tools☆22Oct 25, 2026Updated 3 weeks ago
- My investigation of Voxtral Mini-3B's capabilities.☆15Jul 17, 2025Updated last year
- https://github.com/thu-ml/SageAttention☆20Nov 5, 2025Updated last year
- Custom ComfyUI nodes to streamline and speed up workflows: multi-select and last-image loaders, pixel-art, model upscaling, batched VAE d…☆27Oct 7, 2026Updated last month
- zmk config for the nuty corne nano with a trackpad in each side☆11Sep 2, 2026Updated 2 months ago
- Open source Stable Diffusion examples and workflows for Ryzen AI software☆26Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- C# DDE Client for MetaTrader 4 (via Ndde)☆10Jan 1, 2018Updated 8 years ago
- Open-sourec, local-first Android app that brings Type 1 diabetes and personal health data together and helps you explore it with Tarv1s.☆16Updated this week
- A SDXL trainer modified from kohya trainer.☆24Dec 3, 2025Updated 11 months ago
- Prebuilt SageAttention 2.2.0 wheel for RTX 5090/5080/5070 (Blackwell sm_120) with PyTorch 2.11 nightly and CUDA 12.8. ~35% faster diffusi…☆25Jan 28, 2026Updated 9 months ago
- ⬛ Windows Terminal + 🐧 WSL2 + zsh + Powerlevel10K☆13May 23, 2020Updated 6 years ago
- Documents for fourierN1☆21Oct 26, 2026Updated 3 weeks ago
- Example project for WiiU console application☆20May 24, 2017Updated 9 years ago
- A MIT-licensed, deployable starter kit for building and customizing your own version of AI town - a virtual town where AI characters live…☆25Apr 30, 2024Updated 2 years ago
- Foundational ternary-model inference & training library — CUDA + CPU, BitNet/TQ ternary kernels☆28Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Huntress API☆12May 26, 2022Updated 4 years ago
- ☆12May 22, 2024Updated 2 years ago
- Upgrading Vector's underlying OS☆20Nov 19, 2024Updated 2 years ago
- TUI Docker manager, most features of Portainer plus some...☆21Oct 30, 2026Updated 2 weeks ago
- 1Cat Studio: unified vLLM workbench, Codex Agent and creative canvas☆15Nov 6, 2026Updated last week
- Animate Reachy 2 in Blender and sync its movements to the real robot.☆26Apr 22, 2025Updated last year
- Open-source orchestration for zero-human companies☆20Apr 27, 2026Updated 6 months ago
- linux allwinner h616 kernel based on the orangepi zero 2 version of the legacy allwinner 4.9 bsp kernel☆10Jan 25, 2021Updated 5 years ago
- LLM inference in C/C++☆149Oct 16, 2026Updated last month
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Modern volume mixer for Windows 11 and Windows 10.☆14Jul 22, 2023Updated 3 years ago
- Auto-built Docker image of 1Cat-vLLM for NVIDIA Tesla V100 (sm_70/Volta) with CUDA 12.8 — rebuilt daily when upstream releases☆13Jul 22, 2026Updated 3 months ago
- ☆12Jan 6, 2022Updated 4 years ago
- ☆10Apr 8, 2023Updated 3 years ago
- ☆13Aug 11, 2026Updated 3 months ago
- ☆12Oct 7, 2018Updated 8 years ago
- MCP server for Python code analysis with RUFF linting and VULTURE dead code detection☆11Aug 30, 2026Updated 2 months ago
Are these results useful?