Validated vLLM recipe: Qwen3.8-27B-NVFP4 at full 262,144-token context on a single RTX 5090, GPU-only (no CPU offload).
☆16Aug 20, 2026Updated 2 months ago
Alternatives and similar repositories for Qwen3.8-27B-NVFP4-TurboQuant
Users that are interested in Qwen3.8-27B-NVFP4-TurboQuant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Qwen3.8-27B-NVFP4 on a Single RTX 5090 (vLLM)☆98Aug 16, 2026Updated 2 months ago
- Native DeepSeek V4.1 Flash inference across one RTX PRO 6000 and four DGX Spark expert workers☆36Sep 25, 2026Updated 3 weeks ago
- Qwen3.8-27B ADay777-Ablit · NVFP4 · A4Q · NVFP4-KV (4M+ pool) · MTP-3 — single DGX Spark (GB10/sm121), eugr vLLM 0.27. 1M ctx @ c=4.☆24Aug 17, 2026Updated 2 months ago
- Universal AI computer-control KVM (REST API + MCP) that drives any machine as plain USB hardware — nothing installed on the target. Built…☆20Oct 6, 2026Updated 2 weeks ago
- GLM-5.3-Flash EXL3 (320B MoE) on 2x NVIDIA DGX Spark — production serving kit, 1M context, 97%+ multi-session prefix caching, DFlash2 spe…☆63Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- EXLR8: a DGX Spark tuned quantization format☆13Updated this week
- Uncensored Qwen3.8-27B Ultimate - BF16 master + NVFP4-MIXED deploy. QuickStarts for DGX Spark (one Dynamic DFlash lattice seat @ util 0.8…☆20Oct 6, 2026Updated 2 weeks ago
- Switchless RoCE collectives, NCCL profiles and fabric tooling for DGX Spark inference recipes☆37Updated this week
- Qwen3.8-Flash-Next-NVFP4-vLLM-Dual-DGX-Spark☆409Sep 29, 2026Updated 3 weeks ago
- GLM-5.3-Flash (Z.ai) NVFP4 (LibertAI) + NVFP4 KV, 1M context on 2x DGX Spark GB10 — vLLM TP2 recipe, walls ledger, benchmarks, needle to …☆29Aug 31, 2026Updated last month
- Qwen3.8-27B NVFP4 (W4A16 shipped recipe) + MTP on NVIDIA DGX Spark GB10/SM121 — vLLM v0.27.2rc0, FP8 KV, 262K context, full reproducibili…☆27Aug 20, 2026Updated 2 months ago
- Run on TWO-DGX-Spark - vLLm-0.24.0 dual cache optimized DSV4F+DSpark+NVFP4 KV (Concurrency 12 with 1.5M context/3M KV token Pool) >0.58-0…☆21Aug 17, 2026Updated 2 months ago
- GLM-5.3-Flash (abliterated EXL3) on 2x NVIDIA DGX Spark with the TensorFold engine: 1.8x faster decode than vLLM, 4x256k concurrent threa…☆117Updated this week
- Run the AEON Bench suite on your own hardware: verified HuggingFace pull → serve → benchmark (text · agentic ×3 harnesses · vision · audi…☆25Oct 6, 2026Updated 2 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- MiniMax-M3 (428B, no pruning) at 36 tok/s on 2× NVIDIA DGX Spark — W4A16 GPTQ + NVFP4 KV + EAGLE-3 speculative decoding on vLLM. Three se…☆45Jul 13, 2026Updated 3 months ago
- Free, keyless web_search and web_fetch for the DeepSeek Harness (dsh) — DuckDuckGo-backed, no signup. Unofficial community project.☆17Sep 28, 2026Updated 3 weeks ago
- Fast, capable GLM-5.3-Flash FP4-Local on two DGX Sparks: opinionated Atlas serving and reproducible inference research.☆67Updated this week
- Local-first AI workbench for OCR, transcription, translation, image generation, mind maps and composable workflows. Built for DGX Spark.☆68Sep 2, 2026Updated last month
- qwen38-flash-next recipe for tp=2 GB10☆129Updated this week
- Sharing benchmarks from DGX stations☆27Sep 11, 2026Updated last month
- AEON vLLM Ultimate — vLLM 0.27.1 built from source for DGX Spark / Blackwell (sm_121a/GB10). DSpark quantized Markov heads, DFlash SWA on…☆146Oct 6, 2026Updated 2 weeks ago
- Headless / multi-user serving-mode for the DGX Spark: free unified memory for vLLM by paring back the desktop. Companion to qwen3.5-122B-…☆19Jun 29, 2026Updated 3 months ago
- University of Basel Lecture: Bitcoin Blockchain and Cryptoassets☆14Feb 18, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Homomorphic Encryption Randomness Beacon☆13Dec 3, 2019Updated 6 years ago
- DeepSeek-V4.1-Flash on 2x NVIDIA DGX Spark with the TensorFold engine: 1.8-1.9x code, 2.5x multi-stream, 1.7-1.95x prefill vs the vLLM ki…☆84Updated this week
- Deployment kit: Qwen3.8-27B EXL3 3.5bpw target + DFlash2 EXL3 5.0bpw speculative draft — launcher, config, model cards☆232Sep 1, 2026Updated last month
- Two-node DGX Spark/ASUS GX10 DeepSeek V4 Flash DSpark NVFP4 port for vLLM 0.25, with live dashboard and reproducible deployment.☆81Sep 13, 2026Updated last month
- NVIDIA Nemotron 3.5 Lightning 30B-A3B NVFP4 + DSpark for DGX Spark, RTX 5090/6000 PRO (SGLang)☆23Aug 11, 2026Updated 2 months ago
- vLLM Tune consolidates MoE and FP8 dense GEMM kernel tuning into a single command☆32May 24, 2026Updated 4 months ago
- Qwen3.8-27B on 2× RTX 5090 · 1.49M KV · code/prose t/s: c1 264/216, c16 2,649/2,240 · NVFP4 + vLLM + MTP☆25Updated this week
- A python implementation of distributed key generation over secp256k1☆13Nov 27, 2017Updated 8 years ago
- Adaptation of babyagi in the Open AEA framework☆15May 11, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Grafana dashboard for NVIDIA DGX Spark clusters running vLLM: throughput, contention, and GB10 GPU hardware telemetry (NVIDIA-themed, 55 …☆44Aug 18, 2026Updated 2 months ago
- sound-similarity sample browser via clap☆16Jan 28, 2025Updated last year
- Hikari's curated English measured notes on local LLM systems (serving, specdec, training, steering).☆14Jul 29, 2026Updated 2 months ago
- Verified Qwen3.8 Flash-Next GGUF recipe for one NVIDIA DGX Spark or ASUS Ascent GX10☆61Updated this week
- Tested MiaAI-based DeepSeek V4 Flash speed profile for two ASUS GX10s: pinned patch, settings, and benchmark helper.☆15Sep 5, 2026Updated last month
- GB10 NVFP4 native MTP reproducibility pack for Qwen3.6-35B-A3B☆13May 19, 2026Updated 5 months ago
- Qwen-Image 2.1 on TensorFold's NVFP4 kernels: a drop-in ComfyUI loader, 4x faster than the GGUF path on one RTX 5070 Ti (native Windows).…☆12Oct 3, 2026Updated 2 weeks ago