One-click Qwen3.6-27B inference on Windows. 158 tok/s on RTX 5090, 72 tok/s on RTX 3090. Native, no WSL, no Docker, no telemetry.
☆231May 14, 2026Updated 5 months ago
Alternatives and similar repositories for qwen3.6-windows-server
Users that are interested in qwen3.6-windows-server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Patched native-Windows build of vLLM. Three Windows-specific fixes (CPU-relay for Gloo, Qwen3 reasoning parser, wildcard model name) on t…☆28May 8, 2026Updated 5 months ago
- Native Windows port of NInfer engine for RTX 5090. Features Qwen3.8-27B with QUASAR and NInfer models, MTP/DFlash2 with vision and 262,14…☆73Updated this week
- Native Windows vLLM: 0.27.1 Latest; 0.29.0 Python 3.14/CUDA 13.2 release (CPU TorchAudio), plus Python 3.13/CUDA 13.0 prerelease. PyTorch…☆63Oct 10, 2026Updated last week
- Validated recipe for serving Qwen3.6-27B on a single RTX 5090 — full OpenAI API, vision, tool calling, MTP spec-decode☆74Apr 29, 2026Updated 5 months ago
- Qwen3.6-27B on dual RTX 3090 — TP=2 recipe, vLLM nightly, MTP + fp8 KV, validated for concurrent serving☆58Apr 28, 2026Updated 5 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A high-throughput and memory-efficient inference and serving engine for LLMs (Windows build & kernels)☆670Oct 13, 2026Updated last week
- KVarN, KV cache precision tail, low-bit quants in llama.cpp for longer context of better precision in the same VRAM☆1,168Updated this week
- Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, sglang, llama.cpp and other custom engines) and m…☆2,431Updated this week
- LLM speculative inference server for heterogeneous hardware & consumer GPUs☆2,942Updated this week
- Qwen4-Exp (Qwen3.8-Flash-Next) SWA + MTP + PLE-on-iswa — bounded deep-context decode w/ long-range recall, TBQ4 4.25 bpv KV, DSpark + Rot…☆96Sep 24, 2026Updated 3 weeks ago
- Linux & Powershell scripts to easily set up and run the Qwen 3.5 series locally on Windows and Linux with llama.cpp.☆113Oct 14, 2026Updated last week
- vLLM Docker Container for the latest Qwen 27b☆52Sep 27, 2026Updated 3 weeks ago
- Normalized Attention Guidance for ComfyUI Krea2.☆28Aug 11, 2026Updated 2 months ago
- Benchmarks, compose files, and findings for running Qwen3.6 (27B dense + 35B-A3B MoE) on 4× RTX 3090. vLLM/AWQ vs llama.cpp/GGUF, MTP spe…☆21Aug 15, 2026Updated 2 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆151Jun 13, 2026Updated 4 months ago
- A ComfyUI custom node enabling **Flash Attention 1** on legacy NVIDIA GPUs (Tesla V100, T4) that lack Compute Capability 8.0+ required by…☆31Feb 9, 2026Updated 8 months ago
- ik_llama.cpp's Thireus fork with release builds for macOS/Windows/Ubuntu CPU, Vulkan and CUDA☆181Updated this week
- Web GUI for LLM assisted prose writing☆30Oct 11, 2026Updated last week
- 1CatV2 with TileLANG written FA-v100 and many goodies☆20Jul 15, 2026Updated 3 months ago
- Log Meshtastic nodes telemetry to InfluxDB☆16Aug 14, 2024Updated 2 years ago
- Hydro Desktop — A native desktop workspace for Claude Code, with project-based agents, Notebooks, capability management, scheduled tasks,…☆19Aug 15, 2026Updated 2 months ago
- llama.cpp fork with additional SOTA quants and improved performance☆3,321Updated this week
- Strata fork: Qwen3.8-Flash-Next 125B MoE in NVFP4 on one RTX 20-50 card (12 GB+) and 64 GB of RAM or more. Setup installs our GPTQ quants…☆184Updated this week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- LLM inference in C/C++☆143Oct 16, 2026Updated last week
- Set your keyboard LEDs from the Mac OS X command-line (enables numlock support for CoolerMaster and other non-OSX keyboards)☆10Nov 23, 2019Updated 6 years ago
- Quasar is an inference engine for Qwen3.6-27B-MTP / Qwen3.8-27B on consumer NVIDIA cards as well as Apple Silicon, in the spirit of antir…☆49Updated this week
- Local LLM Inference Speed Test Tool☆243Updated this week
- llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.☆282Updated this week
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆3,125Updated this week
- A local gesture-controlled AI webcam portal built with MediaPipe and ComfyUI. Full-scene styling with Portrait v2, FLUX and Qwen.☆27Oct 7, 2026Updated 2 weeks ago
- A CUDA-accelerated GGUF quantization tool for NVFP4/MXFP6/Q_K, utilizing layer by layer quantization and selection techniques to reduce e…☆49Aug 15, 2026Updated 2 months ago
- Confucius4-R2T2 GGUF Q8 speech-to-text nodes for ComfyUI (Windows/CUDA)☆16Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Mixed-precision acceleration patch for MiniMax H3 inference on NVIDIA V100☆39Sep 6, 2026Updated last month
- SGLang for cool dudes using V100☆80Oct 5, 2026Updated 2 weeks ago
- This project is specifically developed for V100, based on lmdeploy 0.12.1, and supports mainstream open-source models from Q4 2025 to Q1 …☆22Mar 18, 2026Updated 7 months ago
- Local AI workstation — discover, run, chat, benchmark, and generate images from open-weight models. DFlash/DDTree speculative decoding, T…☆25Oct 5, 2026Updated 2 weeks ago
- ☆33Aug 4, 2026Updated 2 months ago
- FastAPI wrapper around original Vibevoice 1.5B and 7B models, with support for AWQ4 quant☆33Jun 22, 2026Updated 4 months ago
- Modified version of Comfyui-WanVideoWrapper☆18Jul 29, 2025Updated last year