Serve Qwen3.8-Flash-Next (turboderp ExLlamaV3 pack) on one NVIDIA DGX Spark with exllamav3
☆64Oct 14, 2026Updated 3 weeks ago
Alternatives and similar repositories for Qwen3.8-Flash-Next-EXL3-DGX-Spark-recipe
Users that are interested in Qwen3.8-Flash-Next-EXL3-DGX-Spark-recipe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Serve DeepSeek-V4-Flash-Vision EXL3 MixedK (full 256 experts) on one NVIDIA DGX Spark with vLLM — recipe, loader patches, and receipts☆14Sep 7, 2026Updated last month
- Verified Qwen3.8 Flash-Next GGUF recipe for one NVIDIA DGX Spark or ASUS Ascent GX10☆60Oct 20, 2026Updated 2 weeks ago
- qwen38-flash-next recipe for solo GB10☆170Oct 30, 2026Updated last week
- Pinned stock Qwen3.8-27B NVFP4 + DFlash2 recipe and measured evidence for one NVIDIA DGX Spark☆21Sep 10, 2026Updated last month
- Qwen3.8 Flash-Next (NVFP4) on NVIDIA Flare for one DGX Spark / ASUS GX10: greedy, 8-agent speculative decoding, mixed prefill☆14Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- DSV4.1-Flash-1017 SAGE EXL3 (1.62 bpw) on one DGX Spark with vLLM: DSpark MTP, cold-expert ATS alias, tile-K 16 MoE, memory guard, measur…☆40Updated this week
- ☆16Sep 25, 2026Updated last month
- An environment where open models work as agents: a first-level harness with routing, skills, memory and sandboxed tools, on an engine tha…☆74Updated this week
- Serve Ornith-1.5-35B-A3B (NVFP4 + in-checkpoint MTP, 256k ctx) on one DGX Spark — vLLM b12x recipe plus CUDA-graph fixes.☆33Aug 19, 2026Updated 2 months ago
- Custom inference recipes for NVIDIA DGX Spark — Qwen 122B DFlash hybrid☆92Updated this week
- vLLM recipe: GLM-5.3-Flash EXL3 K2 on one DGX Spark GB10. Native MTP k=2. Measured tok/s.☆26Sep 10, 2026Updated last month
- Serve EXL3 (ExLlamaV3 trellis) quantized models on vLLM fork runtimes — any architecture, mixed per-layer bitrates, composable with sourc…☆27Updated this week
- Qwen3.8-Flash-Next on ONE DGX Spark (TP=1)☆628Oct 4, 2026Updated last month
- qwen38-flash-next recipe for tp=2 GB10☆133Oct 29, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆15Sep 5, 2026Updated 2 months ago
- Run the AEON Bench suite on your own hardware: verified HuggingFace pull → serve → benchmark (text · agentic ×3 harnesses · vision · audi…☆25Oct 6, 2026Updated last month
- Qwen3.8-27B NVFP4 on SGLang (DGX Spark / SM121): official image pin, native DSpark/EAGLE click-run, matched evals☆21Aug 19, 2026Updated 2 months ago
- Pinned, checksum-verified GLM-5.3-Flash EXL3 K2 recipe for one NVIDIA GB10.☆45Updated this week
- Serve the official Ling-3.0-flash INT4 on one NVIDIA DGX Spark, 38.7 tok/s, faster than the community GGUF. Recipe, watchdog, benchmarks.☆26Aug 29, 2026Updated 2 months ago
- Qwen3.8-Flash-Next (NVFP4) on DGX Spark in vLLM: one Spark 43.9 tok/s with our disk-backed n-gram table patch, staged gather and reduced-…☆137Sep 7, 2026Updated last month
- NVIDIA Nemotron 3.5 Lightning 30B-A3B NVFP4 + DSpark for DGX Spark, RTX 5090/6000 PRO (SGLang)☆24Aug 11, 2026Updated 2 months ago
- Qwen3.8 Flash Next on one DGX Spark (TensorFold)☆376Oct 30, 2026Updated last week
- Qwen3.8-27B on one DGX Spark (TensorFold)☆41Oct 1, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆54Sep 13, 2026Updated last month
- DeepSeek v4 Flash EXL3 on one DGX Spark☆350Aug 24, 2026Updated 2 months ago
- Universal AI computer-control KVM (REST API + MCP) that drives any machine as plain USB hardware — nothing installed on the target. Built…☆20Oct 6, 2026Updated last month
- Three-DGX-Spark TP3 serving recipe for GLM-5.3 Flash☆21Oct 5, 2026Updated last month
- Full GLM-5.3 (753B) served by TensorFold with tensor parallel 4 across four NVIDIA DGX Sparks: results, recipe, node settings, benches☆22Oct 13, 2026Updated 3 weeks ago
- Qwen3.6-27B (NVFP4) DFlash for DGX Spark☆22Jul 31, 2026Updated 3 months ago
- AEON vLLM Ultimate — vLLM 0.27.1 built from source for DGX Spark / Blackwell (sm_121a/GB10). DSpark quantized Markov heads, DFlash SWA on…☆148Oct 6, 2026Updated last month
- A native vLLM 0.26 DGX Spark recipe for Qwen3.6 35B-A3B NVFP4, focused on high aggregate throughput, 262K context, and production-friendl…☆15Aug 31, 2026Updated 2 months ago
- Qwen3.8 27B on SGLang for DGX Spark☆481Sep 12, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Full GLM-5.3 on 4x DGX Spark with kindlingai gr8 (TP4): RigMark prose c1 29.0 -> 40.6 tok/s (+40 %), c4 63.7 -> 76.6☆12Oct 25, 2026Updated last week
- Qwen3.8-27B NVFP4 (W4A16 shipped recipe) + MTP on NVIDIA DGX Spark GB10/SM121 — vLLM v0.27.2rc0, FP8 KV, 262K context, full reproducibili…☆27Aug 20, 2026Updated 2 months ago
- GLM-5.3-Flash EXL3 K2 2.33bpw on ONE DGX Spark: native MTP (layer 45, 288 experts), CUDA graphs on, full 262,144 ctx. Measured ~19 tok/s …☆11Sep 19, 2026Updated last month
- DeepSeek-V4.1-Flash on a single DGX Spark (GB10): resident hot experts + NVMe streaming, DSpark, OpenAI API. Work in progress.☆127Sep 16, 2026Updated last month
- LLM Engine for DGX Spark☆27Oct 31, 2026Updated last week
- Fast & opinionated local AI routing: one MCP server that loads local image and video models on demand on your own GPU box (DGX Spark firs…☆98Updated this week
- Deploy DeepSeek V4 Flash (MoE reasoning model) on dual DGX Spark nodes with 1M token context, InfiniBand, and FP8 KV-cache☆108Aug 20, 2026Updated 2 months ago