One-click Qwen3.6-27B inference on Windows. 158 tok/s on RTX 5090, 72 tok/s on RTX 3090. Native, no WSL, no Docker, no telemetry.
☆230May 14, 2026Updated 5 months ago
Alternatives and similar repositories for qwen3.6-windows-server
Users that are interested in qwen3.6-windows-server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Patched native-Windows build of vLLM. Three Windows-specific fixes (CPU-relay for Gloo, Qwen3 reasoning parser, wildcard model name) on t…☆28May 8, 2026Updated 6 months ago
- Native Windows vLLM 0.33.0 (Python 3.13/CUDA 13.0), plus a Python 3.14/CUDA 13.2 build; older versions on the Releases page. PyTorch 2.14…☆66Updated this week
- LlamaServer大语言模型引擎的启动器，配置集中管理..☆13Aug 7, 2026Updated 3 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs (Windows build & kernels)☆685Updated this week
- Qwen3.6-27B on dual RTX 3090 — TP=2 recipe, vLLM nightly, MTP + fp8 KV, validated for concurrent serving☆58Apr 28, 2026Updated 6 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Benchmarks, compose files, and findings for running Qwen3.6 (27B dense + 35B-A3B MoE) on 4× RTX 3090. vLLM/AWQ vs llama.cpp/GGUF, MTP spe…☆21Aug 15, 2026Updated 2 months ago
- Native Windows port of NInfer engine for RTX 5090. Features Qwen3.8-27B with QUASAR and NInfer models, MTP/DFlash2 with vision and 262,14…☆87Updated this week
- ☆119Apr 28, 2026Updated 6 months ago
- Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, sglang, llama.cpp and other custom engines) and m…☆2,497Updated this week
- Lucebox inference engine for heterogeneous hardware & consumer GPUs☆3,003Updated this week
- Qwen4-Exp (Qwen3.8-Flash-Next) SWA + MTP + PLE-on-iswa — bounded deep-context decode w/ long-range recall, TBQ4 4.25 bpv KV, DSpark + Rot…☆94Sep 24, 2026Updated last month
- A reproducible local LLM benchmarking platform with versioned datasets, deterministic scoring, and auditable reports.☆181Oct 28, 2026Updated 2 weeks ago
- Dockerized inference server and benchmarks for quantized Gemma 4 family on the NVIDIA DGX Spark (GB10). Features ARM64 CUDA 13 builds usi…☆13Jun 20, 2026Updated 4 months ago
- ☆27Apr 8, 2026Updated 7 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Linux & Powershell scripts to easily set up and run the Qwen 3.5 series locally on Windows and Linux with llama.cpp.☆114Nov 3, 2026Updated last week
- vLLM Docker Container for the latest Qwen 27b☆53Sep 27, 2026Updated last month
- ☆11Apr 26, 2026Updated 6 months ago
- 1 spark glm 5.3 flash☆11Sep 7, 2026Updated 2 months ago
- A repository to store helpful information and emerging insights in regard to LLMs☆21Oct 27, 2023Updated 3 years ago
- ik_llama.cpp's Thireus fork with release builds for macOS/Windows/Ubuntu CPU, Vulkan and CUDA☆184Updated this week
- ☆150Jun 13, 2026Updated 4 months ago
- An inference engine for one NVIDIA RTX card, built for a coding agent and its subagents, and a companion that listens, reads and draws: Q…☆63Updated this week
- glm-5.2 on too many 64 / 80 GB A100's☆22Sep 9, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when …☆2,679Updated this week
- llama.cpp fork with additional SOTA quants and improved performance☆3,387Updated this week
- An extension utility for llama.cpp, used with 3090*2 + Strix Halo. llama.cpp的拓展小工具，自用于3090*2 + Strix Halo。☆422Nov 3, 2026Updated last week
- Official OCR mini-bench repository for public use. Typescript Version.☆12Jul 3, 2026Updated 4 months ago
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆3,332Updated this week
- A ComfyUI custom node enabling **Flash Attention 1** on legacy NVIDIA GPUs (Tesla V100, T4) that lack Compute Capability 8.0+ required by…☆34Feb 9, 2026Updated 9 months ago
- Qwen3.8-Flash-Next (MoE) and Qwen3.8-27B on one or two 16 GB RTX 50-series GPUs: experts offloaded to CPU, two-GPU tensor parallel. 64 GB…☆144Updated this week
- Set your keyboard LEDs from the Mac OS X command-line (enables numlock support for CoolerMaster and other non-OSX keyboards)☆10Nov 23, 2019Updated 6 years ago
- ☆24Dec 29, 2025Updated 10 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A modular statusline for Claude Code CLI - real-time context usage, rate limits, costs, git status, and 20+ customizable modules☆27Nov 4, 2026Updated last week
- Qwen3.8-Flash-Next on 2× RTX 3090: with 128 GB RAM up to 4,191 tok/s prefill · 111.5 tok/s decode (131K prompt), full 256K window at 2,86…☆141Oct 15, 2026Updated 3 weeks ago
- Local inference engine optimized for NVIDIA Blackwell☆960Updated this week
- Test LLMs on real tasks. Compare models side-by-side.☆432Aug 10, 2026Updated 3 months ago
- Hyper optimised Qwen3.8-27B inference on one RTX 3090: ReplaySSM, MTP3, reasoning effort, C1-C8 batching, and native Windows and Linux bu…☆512Oct 31, 2026Updated last week
- Browser workbench for Baidu Unlimited OCR 2: PDF/image OCR, GPU/RAM monitoring, recording mode, Base/Gundam comparison and CER checks.☆22Oct 30, 2026Updated 2 weeks ago
- Local AI workstation: chat by voice or text, transcribe, generate images and video (with sound on Apple Silicon), benchmark and serve ope…☆26Updated this week
Are these results useful?