One-click Qwen3.6-27B inference on Windows. 158 tok/s on RTX 5090, 72 tok/s on RTX 3090. Native, no WSL, no Docker, no telemetry.
☆222May 14, 2026Updated 2 months ago
Alternatives and similar repositories for qwen3.6-windows-server
Users that are interested in qwen3.6-windows-server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Validated recipe for serving Qwen3.6-27B on a single RTX 5090 — full OpenAI API, vision, tool calling, MTP spec-decode☆66Apr 29, 2026Updated 2 months ago
- DFlash & TurboQuant in llama.cpp with up to 3x faster generation and 7.5x more KV cache in same VRAM☆772Updated this week
- Qwen3.6-27B on dual RTX 3090 — TP=2 recipe, vLLM nightly, MTP + fp8 KV, validated for concurrent serving☆54Apr 28, 2026Updated 2 months ago
- ☆21Apr 8, 2026Updated 3 months ago
- ☆140Jun 13, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- vLLM Docker Container for Qwen3.6 27b☆51Jun 15, 2026Updated last month
- Fused TBQ4 Flash Attention + MTP + Shared Tensors for llama.cpp — 82+ tok/s with lossless 4.25 bpv KV cache at 200K context on RTX 4090☆88May 17, 2026Updated last month
- A high-throughput and memory-efficient inference and serving engine for LLMs (Windows build & kernels)☆566Updated this week
- Auto-tuned launcher for GGUF models on llama.cpp / ik_llama.cpp — OpenAI-compatible server with multi-GPU tensor-split, MoE expert placem…☆252Updated this week
- Windows desktop control panel for local llama.cpp server☆301Updated this week
- This project is specifically developed for V100, based on lmdeploy 0.12.1, and supports mainstream open-source models from Q4 2025 to Q1 …☆21Mar 18, 2026Updated 3 months ago
- Implementation of FlashAttention-2 for Nvidia Tesla V100 / Titan V☆173Jun 30, 2026Updated 2 weeks ago
- LLM training & inference in python/C++ with web UI☆36Updated this week
- A repository to store helpful information and emerging insights in regard to LLMs☆21Oct 27, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Linux & Powershell scripts to easily set up and run the Qwen 3.5 series locally on Windows and Linux with llama.cpp.☆90Apr 28, 2026Updated 2 months ago
- ☆20Jun 3, 2026Updated last month
- Open source tool for transcirption and subtitling, alternative to happyscribe.☆36Feb 12, 2025Updated last year
- ☆22Jun 13, 2024Updated 2 years ago
- SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86, 2× A5000/3090). Qwen3.6-35…☆122Updated this week
- A UWP application using the Lamp API to control the flashlight on a Windows device☆11Jun 17, 2023Updated 3 years ago
- Fully uncensored, capability-enhanced abliteration of Qwen3.6-27B. NVFP4 + z-lab DFlash speculative decoding (n=12) on the unified ghcr.i…☆416Jul 3, 2026Updated last week
- ☆90Feb 1, 2026Updated 5 months ago
- A self-hosted, lightweight, visual ETL (Extract, Transform, Load) platform inspired by Alteryx.☆48Jun 9, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 🤵 AIfred-Intelligence — self-hosted Multi-Agent Assistant with Debate Modes (Symposion/Tribunal), Voice (STT + Streaming-TTS), RAG with …☆33Updated this week
- Majoor Assets Manager is an advanced asset browser for ComfyUI that provides a comprehensive solution for managing, organizing, and viewi…☆120Updated this week
- LLM inference in C/C++☆2,097Updated this week
- This repo contains the critical chat_template.jinja fix for Qwen3/3.5/3.6 to work smoothly in agentic task.☆92May 2, 2026Updated 2 months ago
- ComfyUI-UniversalBlockSwap☆49Sep 18, 2025Updated 9 months ago
- An electron Wrapper for Open-Interpreter for the lablab.ai hackathon☆12Oct 14, 2023Updated 2 years ago
- UnPlayer is a fully automatic Rainmeter player. Switch between your many media players seamlessly.☆10Feb 22, 2021Updated 5 years ago
- NVFP4 Gemma-4 26B-A4B MoE for DGX Spark — optimal recipe: DFlash n=10 (flex) on AEON vLLM Ultimate. 144 tok/s single / 1,724 peak (Coding…☆42Jun 28, 2026Updated 2 weeks ago
- A harness optimized to smaller LLMs☆1,754Jul 6, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- simple diffusers based implementation of Hunyuan-DiT, in Forge webUI for Stable Diffusion. Works with 8GB VRAM.☆17Feb 20, 2025Updated last year
- Caterpillar is a security scanning library for AI agent skill files (e.g., Claude Code skills) for dangerous or malicious behavior☆62Feb 16, 2026Updated 4 months ago
- ☆24Sep 20, 2025Updated 9 months ago
- Long-Term Memory plugin for Claude Code — semantic search, context injection, session learning☆26Jun 10, 2026Updated last month
- ComfyUI Prompt enhancer for ideogram4 powered by llama cpp☆45Jun 11, 2026Updated last month
- ☆32Jun 15, 2024Updated 2 years ago
- Extract2MD is a powerful and versatile AI-enabled client-side JavaScript library for extracting text from PDF files and converting it int…☆108Apr 7, 2026Updated 3 months ago