Patched native-Windows build of vLLM. Three Windows-specific fixes (CPU-relay for Gloo, Qwen3 reasoning parser, wildcard model name) on top of SystemPanic 0.19.0. Engine for devnen/qwen3.6-windows-server.
☆28May 8, 2026Updated 5 months ago
Alternatives and similar repositories for vllm-windows
Users that are interested in vllm-windows are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- One-click Qwen3.6-27B inference on Windows. 158 tok/s on RTX 5090, 72 tok/s on RTX 3090. Native, no WSL, no Docker, no telemetry.☆231May 14, 2026Updated 4 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs (Windows build & kernels)☆660Updated this week
- Custom ComfyUI nodes to streamline and speed up workflows: multi-select and last-image loaders, pixel-art, model upscaling, batched VAE d…☆27Updated this week
- fast-embeddings-api☆16Nov 23, 2023Updated 2 years ago
- A visually refreshed Service Manager for Windows with additional functions☆14Feb 8, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- BOSSA is the programming software used to program SAM-based Arduino boards like Flutter. We added our chip.☆12Mar 17, 2015Updated 11 years ago
- ☆42Jun 17, 2026Updated 3 months ago
- linux allwinner h616 kernel based on the orangepi zero 2 version of the legacy allwinner 4.9 bsp kernel☆10Jan 25, 2021Updated 5 years ago
- ☆14Apr 8, 2025Updated last year
- Free OneDrive / Google Drive / Dropbox client which encrypts your data before upload.☆14May 3, 2020Updated 6 years ago
- 一套基于Vllm的显存内存混合模式大模型部署工具（图形界面），VRAMandDRAM模式虽然慢一点，但是解决了超大模型在普通家用计算机上的部署问题。☆99Apr 27, 2025Updated last year
- 一个 Windows 网络配置切换器，可以在多个预设配置间快速切换，使用 WinUI3。☆23Aug 13, 2026Updated last month
- Provides ComfyUI nodes for OIDN image denoising☆11Nov 27, 2024Updated last year
- ☆10Apr 8, 2023Updated 3 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- ☆12Oct 7, 2018Updated 8 years ago
- ComfyUI-KokoroTTS: A text-to-speech model that utilizes the Kokoro TTS framework to convert text into natural-sounding speech. It suppor…☆13Apr 18, 2025Updated last year
- ff-rknn - Real-time Object Detection with NPU (Rockchip)☆14Sep 5, 2023Updated 3 years ago
- PyQt(+PySide) Stable Diffusion GUI☆15Aug 1, 2023Updated 3 years ago
- OpenScribe is an open source editor app that aims to replace the standard Windows editor with advanced features. But also available for A…☆11Oct 30, 2023Updated 2 years ago
- A companion app for all UWP devices for the Technical University of Munich.☆13Jul 28, 2023Updated 3 years ago
- Rewrite of the MVVM App with Community toolkit 8☆11May 14, 2023Updated 3 years ago
- 基于.net core2.1 搭建的框架的中小型项目框架,sql server数据库,同时支持,mysql数据库,,,需要自己稍微扩展下,,,可以擦模考sql server的实现 迁移文件已经生成,可以直接运行即可跑起来. 结合docker发布可以参考这里: https…☆13Dec 4, 2018Updated 7 years ago
- ☆17Jun 15, 2026Updated 3 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- MangoPI MQ-Quad board Linux (Allwinner H616)☆12Apr 6, 2023Updated 3 years ago
- A UWP application using the Lamp API to control the flashlight on a Windows device☆11Jun 17, 2023Updated 3 years ago
- Just a playground app to learn about Windows development.☆12Apr 7, 2023Updated 3 years ago
- ☆10Aug 10, 2015Updated 11 years ago
- 🔋Show the battery percentage in the system tray in an attempt to improve the Windows 11 taskbar (why do you not show the battery % in th…☆12Mar 31, 2023Updated 3 years ago
- CSS3与页面布局学习总结（一）——概要、选择器、特殊性与刻度单位☆14Nov 24, 2016Updated 9 years ago
- Translate text with one hotkey.☆13Mar 14, 2023Updated 3 years ago
- This repository is a mirror of https://git.openwrt.org/openwrt/openwrt.git It is for reference only and is not active for check-ins. We …☆15Mar 10, 2026Updated 7 months ago
- RedisMQDemo☆11Jun 13, 2019Updated 7 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Notes on flashing and usage of Radxa Rock board☆12Dec 24, 2020Updated 5 years ago
- WebAISum is a Python script that allows you to summarize web pages using AI models. It supports both local models like Ollama and remote …☆15Apr 28, 2024Updated 2 years ago
- Attach a debug node to an output to get more information.☆15Jun 14, 2024Updated 2 years ago
- Replayable Browser Agent☆17Apr 24, 2026Updated 5 months ago
- 基于Winform的一套商家管理工具，用来练习界面布局，自动更新，事件，异步，多线程，网络请求，缓存使用，任务存储，设计模式，爬虫流程，反爬虫机制等功能的一个Demo☆10Dec 8, 2022Updated 3 years ago
- .NET 跨平台微服务架构解决方案☆16Jul 10, 2026Updated 3 months ago
- 扩充图片库至40+倍的工具，常用于扩充对象识别的训练集☆11Jan 4, 2023Updated 3 years ago