Qwen3.8-27B-NVFP4 on a Single RTX 5090 (vLLM)
☆100Aug 16, 2026Updated 2 months ago
Alternatives and similar repositories for Qwen3.8-27B-NVFP4-RTX-5090
Users that are interested in Qwen3.8-27B-NVFP4-RTX-5090 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Native DeepSeek V4.1 Flash inference across one RTX PRO 6000 and four DGX Spark expert workers☆39Sep 25, 2026Updated last month
- Qwen3.8-27B on 2× RTX 5090 · 1.49M KV · code/prose t/s: c1 264/216, c16 2,649/2,240 · NVFP4 + vLLM + MTP☆26Oct 21, 2026Updated 2 weeks ago
- GLM-5.3-Flash EXL3 (320B MoE) on 2x NVIDIA DGX Spark — production serving kit, 1M context, 97%+ multi-session prefix caching, DFlash2 spe…☆64Updated this week
- NVIDIA Nemotron 3.5 Lightning 30B-A3B NVFP4 + DSpark for DGX Spark, RTX 5090/6000 PRO (SGLang)☆24Aug 11, 2026Updated 2 months ago
- Deployment kit: Qwen3.8-27B EXL3 3.5bpw target + DFlash2 EXL3 5.0bpw speculative draft — launcher, config, model cards☆233Sep 1, 2026Updated 2 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Qwen3.8-27B ADay777-Ablit · NVFP4 · A4Q · NVFP4-KV (4M+ pool) · MTP-3 — single DGX Spark (GB10/sm121), eugr vLLM 0.27. 1M ctx @ c=4.☆24Aug 17, 2026Updated 2 months ago
- All-NVFP4 vLLM + DFlash2 K7 for Blackwell (SM120/SM121): NVFP4 target/draft/KV, 262K context, optional CPU vision sidecar.☆41Aug 28, 2026Updated 2 months ago
- Claude Code skill: let your agent drive fleets of local omp (oh-my-pi) model instances toward one goal — provider config, bounded turns, …☆15Aug 28, 2026Updated 2 months ago
- Three-DGX-Spark TP3 serving recipe for GLM-5.3 Flash☆21Oct 5, 2026Updated last month
- Reproducible recipe: serve abliterated Gemma-4-12B (gemma4_unified) at 50-118 tok/s on no-NVLink Blackwell (SM120) via vLLM nightly + Mod…☆14Jun 7, 2026Updated 5 months ago
- DeepSeek-V4.1-Flash on a single DGX Spark (GB10): resident hot experts + NVMe streaming, DSpark, OpenAI API. Work in progress.☆127Sep 16, 2026Updated last month
- Qwen3.8-27B NVFP4 (W4A16 shipped recipe) + MTP on NVIDIA DGX Spark GB10/SM121 — vLLM v0.27.2rc0, FP8 KV, 262K context, full reproducibili…☆27Aug 20, 2026Updated 2 months ago
- Fast, capable GLM-5.3-Flash FP4-Local on two DGX Sparks: opinionated Atlas serving and reproducible inference research.☆72Updated this week
- vLLM inference solutions for NVIDIA GB10 (DGX Spark, sm121) — KIMI-K3 B12X_MLA + DSpark, GLM-5.2☆69Sep 30, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Pi extension for SpaceXAI Grok/X.com Subscriptions☆14Aug 13, 2026Updated 2 months ago
- Qwen3.8-Flash-Next on two DGX Sparks with TensorFold☆50Oct 26, 2026Updated last week
- DeepSeek-v4-Flash 0731 recipe for 2x DGX Sparks☆1,512Oct 4, 2026Updated last month
- A reliability harness for running Pi coding agents with local language models.☆23Aug 30, 2026Updated 2 months ago
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆3,283Updated this week
- DeepSeek 1017 EXL3 on 3-4 DGX Sparks. TP4 4.0.4: 4,277 tok/s cold prefill; C16 code 331.7 / prose 287.5 native decode sum. Smart CUDA Gra…☆19Updated this week
- qwen38-flash-next recipe for tp=2 GB10☆133Oct 29, 2026Updated last week
- W4A4 full（VLLM_MOE_W4A4=2）+ （VLLM_B12X_SHARED_WRAPPER=1）+ FlashInfer 0.6.16 + threshold 4096 + util 0.78 + DSpark MTP n7 + CUMEM=0☆16Aug 26, 2026Updated 2 months ago
- MRS-Core provides a transparent, modular, reproducible reasoning substrate.☆11Feb 3, 2026Updated 9 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- GLM-5.3 Flash EXL3 for 2-4x DGX Sparks☆749Updated this week
- Create locally. A local asset and REF2VA video studio for ComfyUI, powered by Qwen-Image 2.1, MiniMax H3 and the official Comfy SDK.☆22Updated this week
- Time-boxed passwordless sudo for agents. Grants expire on a systemd timer, validated with visudo before install, audited with sudoreplay.☆27Sep 3, 2026Updated 2 months ago
- MiniMax M2.7 NVFP4 dual-GB10 Blackwell benchmark: vLLM FlashInfer-CUTLASS, public data, HTML canvas report, and Docker runtime.☆13May 24, 2026Updated 5 months ago
- One-menu RTX 5090 installer for the abliterated Qwen3.8-Flash-Next on fngine: pinned build with isolated CUDA, verified download, serving…☆14Oct 15, 2026Updated 3 weeks ago
- ☆22Sep 7, 2026Updated 2 months ago
- Qwen3.6 27B × DFlash — 30-35 tok/s on NVIDIA DGX Spark (GB10) - LLama.Cpp☆17May 2, 2026Updated 6 months ago
- AEON vLLM Ultimate — vLLM 0.27.1 built from source for DGX Spark / Blackwell (sm_121a/GB10). DSpark quantized Markov heads, DFlash SWA on…☆149Oct 6, 2026Updated last month
- sparkDash ⚡ — Multi-DGX Spark Monitoring Dashboard☆839Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Qwen3.8-27B on SGLang for NVIDIA RTX PRO 6000 (96GB, SM120): DSpark speculative decoding, full 256K context, 8 concurrent requests☆61Aug 24, 2026Updated 2 months ago
- ☆17Aug 16, 2026Updated 2 months ago
- Keyless browser entry, LAN hostname access, and a Tailscale address alias for a DeepSeek Harness web profile☆25Updated this week
- A wordpress plugin that creates a paywall for almost any wordpress content, payable in bitcoin over the lightning network☆11Nov 2, 2020Updated 6 years ago
- Archived: b12x development has moved to FlashInfer. See README for migration and PR-porting guidance.☆270Oct 6, 2026Updated last month
- Double-click installer for MiniMax-H3 Turbo video, auto-maps to your RTX or GTX or DGX Spark , such as 3090, 4090 etc.☆19Aug 25, 2026Updated 2 months ago
- GLM-5.3-Flash (abliterated EXL3) on 2x NVIDIA DGX Spark with the TensorFold engine: 1.8x faster decode than vLLM, 4x256k concurrent threa…☆121Oct 30, 2026Updated last week