Patched native-Windows build of vLLM. Three Windows-specific fixes (CPU-relay for Gloo, Qwen3 reasoning parser, wildcard model name) on top of SystemPanic 0.19.0. Engine for devnen/qwen3.6-windows-server.
☆28May 8, 2026Updated 5 months ago
Alternatives and similar repositories for vllm-windows
Users that are interested in vllm-windows are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- One-click Qwen3.6-27B inference on Windows. 158 tok/s on RTX 5090, 72 tok/s on RTX 3090. Native, no WSL, no Docker, no telemetry.☆231May 14, 2026Updated 5 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs (Windows build & kernels)☆679Updated this week
- LLM inference in C/C++☆12Oct 18, 2026Updated last week
- A translator based on text generation webui allow you use local language model to translate epub book☆16Jun 11, 2023Updated 3 years ago
- The installation of the InsightFace package on a Windows environment, including the necessary dependencies and configurations.☆18Sep 10, 2024Updated 2 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Open-source AI memory system for Even Realities G2 smart glasses: voice capture, agent-loop recall over your knowledge base, and meeting …☆12Jul 26, 2026Updated 3 months ago
- Nunchaku FLUX LoRA Stacker with dynamic UI control and various tools☆23Updated this week
- Lynn GitHub 镜像仓 · Qwen3.8-27B Coder390 EfficientThink 本地 GGUF（llama.cpp Q2/Q3，内置 Q4 MTP）· 主仓 https://github.com/MerkyorLynn/Lynn · 下载 htt…☆36Updated this week
- https://github.com/thu-ml/SageAttention☆20Nov 5, 2025Updated 11 months ago
- Custom ComfyUI nodes to streamline and speed up workflows: multi-select and last-image loaders, pixel-art, model upscaling, batched VAE d…☆27Oct 7, 2026Updated 3 weeks ago
- SGLang for cool dudes using V100☆82Oct 5, 2026Updated 3 weeks ago
- Prebuilt SageAttention 2.2.0 wheel for RTX 5090/5080/5070 (Blackwell sm_120) with PyTorch 2.11 nightly and CUDA 12.8. ~35% faster diffusi…☆25Jan 28, 2026Updated 9 months ago
- Modern volume mixer for Windows 11 and Windows 10.☆14Jul 22, 2023Updated 3 years ago
- ESP32 e-paper frame that renders human-made 1800's art prints for the birds detected in your backyard with BirdNET or BirdWeather☆25Updated this week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ComfyUI custom node: run MiniMax H3 at near-fp16 speed with near-fp32 numerical stability on GPUs without bf16/fp8 hardware (V100 sm_70)☆19Aug 22, 2026Updated 2 months ago
- A MIT-licensed, deployable starter kit for building and customizing your own version of AI town - a virtual town where AI characters live…☆25Apr 30, 2024Updated 2 years ago
- Use key or voice commands to direct your voice to any app or service you require, local or remote.☆29Updated this week
- ☆42Jun 17, 2026Updated 4 months ago
- Media library integrated with multiple online services ( Anilist, MAL, Kitsu ) in one UWP app.☆12Dec 8, 2022Updated 3 years ago
- Auto-built Docker image of 1Cat-vLLM for NVIDIA Tesla V100 (sm_70/Volta) with CUDA 12.8 — rebuilt daily when upstream releases☆12Jul 22, 2026Updated 3 months ago
- SageThumbs is a powerful shell extension allowing to preview enormous amount of image formats directly in Windows Explorer by using Pierr…☆60May 19, 2024Updated 2 years ago
- SuperPixie is a self-addressing, chainable display platform for Arduino☆13Sep 25, 2023Updated 3 years ago
- Native Windows port of NInfer engine for RTX 5090. Features Qwen3.8-27B with QUASAR and NInfer models, MTP/DFlash2 with vision and 262,14…☆78Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆11Apr 6, 2025Updated last year
- Win11 native application notebook based on WinUi3 design☆10May 25, 2023Updated 3 years ago
- App to add Tiles from your games in Windows 10☆16Jul 1, 2024Updated 2 years ago
- ☆10Apr 8, 2023Updated 3 years ago
- source code for RTD2662☆12Nov 26, 2018Updated 7 years ago
- ☆13Aug 11, 2026Updated 2 months ago
- 基于AutoGLM的 Android 自动化框架，集成 LADB 实现无 Root 智能控制☆11Dec 25, 2025Updated 10 months ago
- Just a playground app to learn about Windows development.☆12Apr 7, 2023Updated 3 years ago
- ComfyUI nodes to use DiLightNet☆11Oct 6, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Band decoder for an Icom IC-705 radio using Bluetooth Low Energy (BLE) and BT Classic Serial Port Profile for CI-V control and USB Host f…☆12May 18, 2026Updated 5 months ago
- A JavaScript library for muxing and demuxing animated WebP images and encoding and decoding WebP images.☆27Jan 6, 2023Updated 3 years ago
- 一个基 于 WinRT OCR 的文本提取器☆11Sep 18, 2026Updated last month
- A high resolution version of the Krita AI Diffusion plugin with numerous improvements in processing of large and ultra-large images☆15Sep 4, 2025Updated last year
- 🔋Show the battery percentage in the system tray in an attempt to improve the Windows 11 taskbar (why do you not show the battery % in th…☆12Mar 31, 2023Updated 3 years ago
- LDROBOT developer Kit☆15Jun 28, 2022Updated 4 years ago
- Code for Arduino based BGA Rework Station controller using a solid state relay and a k-type thermocouple.☆11Dec 9, 2017Updated 8 years ago