Qwen3.8-27B on 16-32 GB Nvidia GPUs one-click install for Windows / Linux
☆596Oct 9, 2026Updated 2 weeks ago
Alternatives and similar repositories for Qwen3.8-27B-16gb-NVIDIA-GPUs-one-click-install
Users that are interested in Qwen3.8-27B-16gb-NVIDIA-GPUs-one-click-install are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Deployment kit: Qwen3.8-27B EXL3 3.5bpw target + DFlash2 EXL3 5.0bpw speculative draft — launcher, config, model cards☆233Sep 1, 2026Updated last month
- One llama.cpp flag unlocks +33-39% decode speed for Qwen3.8-27B on consumer GPUs. The MTP head already ships inside your GGUF. Recipe, pa…☆365Sep 26, 2026Updated last month
- Mirai S (Qwen3.8-27B-S trellis GGUF) on a 12 GB RTX 4070: 262k q8_0 tiered cache, MTP drafting at every depth, harness-proofing, the laye…☆104Oct 20, 2026Updated last week
- GLM-5.3 Flash EXL3 for 2-4x DGX Sparks☆745Oct 18, 2026Updated last week
- DeepSeek v4.1 Flash EXL3 2.9 bpw for 2x DGX Sparks☆279Sep 19, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Qwen3.8-Flash-Next-NVFP4-vLLM-Dual-DGX-Spark☆411Sep 29, 2026Updated last month
- An experimental and feature-rich inference engine built on top of llama.cpp☆81Updated this week
- Qwen3.8 27B on SGLang for DGX Spark☆479Sep 12, 2026Updated last month
- Qwen3.8-Flash-Next on ONE DGX Spark (TP=1)☆621Oct 4, 2026Updated 3 weeks ago
- Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on loca…☆35,851Updated this week
- GLM-5.3-Flash EXL3 on one 24 GB RTX 3090 + DDR4: elastic GPU expert cache, zero-copy experts, AVX2 CPU tier, OpenAI API☆347Oct 18, 2026Updated last week
- sparkDash ⚡ — Multi-DGX Spark Monitoring Dashboard☆774Updated this week
- GLM-5.3-Flash EXL3 K2 2.33bpw on ONE DGX Spark: native MTP (layer 45, 288 experts), CUDA graphs on, full 262,144 ctx. Measured ~19 tok/s …☆11Sep 19, 2026Updated last month
- Easy local setup for Qwen3.8-27B Abliterated: 256K context and measured 240-300 tokens/s generation on an RTX 5090.☆33Sep 20, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- LLM Inference Engine for Metal, CUDA and Vulkan.☆1,532Updated this week
- DeepSeek-v4-Flash 0731 recipe for 2x DGX Sparks☆1,497Oct 4, 2026Updated 3 weeks ago
- GLM-5.3-Flash EXL3 on 2x DGX Spark with TensorFold☆504Updated this week
- Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when …☆2,413Oct 21, 2026Updated last week
- Fast, capable GLM-5.3-Flash FP4-Local on two DGX Sparks: opinionated Atlas serving and reproducible inference research.☆71Updated this week
- Qwen3.8-27B on one DGX Spark (TensorFold)☆38Oct 1, 2026Updated 3 weeks ago
- FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.☆14,817Updated this week
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆1,763Updated this week
- DeepSeek-V4.1-Flash on two NVIDIA DGX Sparks: EXL3 weights from the official checkpoint, upstream vLLM with our patches and decode kernel…☆45Oct 22, 2026Updated last week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- What actually runs on an RTX 3060 12GB, if you have any card with 12GB vram, this is for you as well. measured, with commands☆164Aug 22, 2026Updated 2 months ago
- Serve Qwen3.8-Flash-Next (turboderp ExLlamaV3 pack) on one NVIDIA DGX Spark with exllamav3☆63Oct 14, 2026Updated 2 weeks ago
- run a 27b local ai on your gaming gpu, rtx 3060 and up, radeon rx 6600 and up in beta, 8gb or more, linux and windows, one line to instal…☆168Oct 17, 2026Updated last week
- Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own …☆2,190Updated this week
- DeepSeek-V4.1-Flash EXL3 on one 24 GB RTX 3090 + DDR4 + NVMe: staged-DMA prefill, AVX2 CPU expert tier, elastic VRAM expert cache, Engram…☆153Oct 12, 2026Updated 2 weeks ago
- Experimental llama.cpp fork for inference research and development☆893Updated this week
- Run on TWO-DGX-Spark - vLLm-0.24.0 dual cache optimized DSV4F+DSpark+NVFP4 KV (Concurrency 12 with 1.5M context/3M KV token Pool) >0.58-0…☆21Aug 17, 2026Updated 2 months ago
- ☆696Updated this week
- qwen38-flash-next recipe for tp=2 GB10☆130Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- DeepSeek-V4.1-Flash on 2x NVIDIA DGX Spark with the TensorFold engine: 1.8-1.9x code, 2.5x multi-stream, 1.7-1.95x prefill vs the vLLM ki…☆93Updated this week
- LLM speculative inference server for heterogeneous hardware & consumer GPUs☆2,961Updated this week
- KVarN, KV cache precision tail, low-bit quants in llama.cpp for longer context of better precision in the same VRAM☆1,177Updated this week
- ☆20Sep 17, 2026Updated last month
- LLM Engine for DGX Spark☆26Updated this week
- A pixel art space shooter built entirely by a 9B AI model on a single RTX 3060. Zero hand-written code.☆106Mar 19, 2026Updated 7 months ago
- Full GLM-5.3 (753B) served by TensorFold with tensor parallel 4 across four NVIDIA DGX Sparks: results, recipe, node settings, benches☆20Oct 13, 2026Updated 2 weeks ago