Working recipe to serve DeepSeek-V4-Flash across two NVIDIA DGX Spark (GB10) nodes with vLLM (TP=2, FP8 KV, MTP) over a RoCE/RDMA link — Docker image, launch scripts, RDMA/NCCL setup, and the gotchas.
☆84Jul 13, 2026Updated 3 months ago
Alternatives and similar repositories for Deepseek-v4-Flash-TP2-DGX-Spark-500k-CTX
Users that are interested in Deepseek-v4-Flash-TP2-DGX-Spark-500k-CTX are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MiniMax-M3 (428B, no pruning) at 36 tok/s on 2× NVIDIA DGX Spark — W4A16 GPTQ + NVFP4 KV + EAGLE-3 speculative decoding on vLLM. Three se…☆45Jul 13, 2026Updated 3 months ago
- Autonomous self-improving 4x DGX Spark (GB10) MoA stack + LoRA loop (DSV4F router, Qwen3.6/Omni/TwoTower/Gemma). Hermes MoA routing, ~90%…☆24Aug 17, 2026Updated 2 months ago
- Deploy DeepSeek V4 Flash (MoE reasoning model) on dual DGX Spark nodes with 1M token context, InfiniBand, and FP8 KV-cache☆108Aug 20, 2026Updated 2 months ago
- DeepSeek V4 Flash DSpark 1M NVFP4 KV recipe for 2x DGX Spark☆496Sep 10, 2026Updated 2 months ago
- GLM-5.3-Flash (Z.ai) NVFP4 (LibertAI) + NVFP4 KV, 1M context on 2x DGX Spark GB10 — vLLM TP2 recipe, walls ledger, benchmarks, needle to …☆29Aug 31, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Model-agnostic LLM benchmarking + tuning in one command. A model is a 15-key profile file. Built in production on a 4x NVIDIA DGX Spark c…☆10Sep 16, 2026Updated last month
- GLM-5.2 744B with a true 4-bit NVFP4 KV cache on 4x DGX Spark: 42 tok/s peak, 317K-token KV pool (+58.6% vs fp8), needle-verified at 250K…☆15Jul 21, 2026Updated 3 months ago
- DeepSeek-V4-Flash native Blackwell FP8 benchmark on dual DGX Spark GB10 (TP=2, MTP, RoCE). c=1 38.4 t/s, c=16 144.6 t/s aggregate.☆13Jun 16, 2026Updated 4 months ago
- ☆13Aug 27, 2026Updated 2 months ago
- Recipe: GLM-5.2 (unpruned QuantTrio Int4-Int8Mix) at 200K ctx with MTP spec decode on a 4x NVIDIA DGX Spark (GB10) cluster☆77Jul 25, 2026Updated 3 months ago
- GLM-5.2 QuantTrio TP=4+DCP2 on 4x NVIDIA DGX Spark (GB10) — tuned and measured under a real agent workload. Adaptive MTP, the indexer law…☆20Aug 24, 2026Updated 2 months ago
- Run DeepSeek-V4-Flash at full 1M context AND two MiniMax H3 video instances on the same two DGX Sparks. Benchmarked C1-C6.☆36Aug 7, 2026Updated 3 months ago
- 8s of H3 video in 2m54s warm delivery on two DGX Sparks. Scene-specific LTX refinement, original-voice restoration, measured sync, clips …☆24Sep 12, 2026Updated 2 months ago
- Local diagnostic CLI for NVIDIA DGX Spark (GB10). Detects power caps, UMA pressure, thermal risk, CUDA 13/SM_121 wheel mismatches, Docker…☆166Oct 22, 2026Updated 3 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- DeepSeek-v4-Flash 0731 recipe for 2x DGX Sparks☆1,516Oct 4, 2026Updated last month
- Index / recipe book for every GLM-5.3 (and GLM-5.2 foundation) serving recipe on NVIDIA DGX Spark (GB10): Flash + big 743B, TP2 + TP4, ev…☆14Aug 29, 2026Updated 2 months ago
- DeepSeek V4 Flash @ 1M token context on 2x NVIDIA DGX Spark — production-tested recipe (45 tok/s decode, real 800K prompts served)☆37Jul 13, 2026Updated 3 months ago
- DeepSeek-V4-Flash-0731 tuned on 4x DGX Spark (GB10) at TP=4 — 123.13 tok/s decode. Every variable measured one at a time, with the values…☆13Aug 11, 2026Updated 3 months ago
- DeepSeek-V4.1-Flash on 4x DGX Spark (GB10): exact 4-node TensorFold (Zig) recipe, vision, 1M context☆13Nov 4, 2026Updated last week
- ☆16Sep 25, 2026Updated last month
- Full GLM-5.3 (753B) served by TensorFold with tensor parallel 4 across four NVIDIA DGX Sparks: results, recipe, node settings, benches☆22Oct 13, 2026Updated 3 weeks ago
- A community-owned map of LLM inference engine configurations — benchmarks, evals and coverage gaps, hosted on GitHub Pages. The repo is t…☆16Oct 19, 2026Updated 3 weeks ago
- Qwen3.8-27B ADay777-Ablit · NVFP4 · A4Q · NVFP4-KV (4M+ pool) · MTP-3 — single DGX Spark (GB10/sm121), eugr vLLM 0.27. 1M ctx @ c=4.☆24Aug 17, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- MiniMax M2.7 NVFP4 dual-GB10 Blackwell benchmark: vLLM FlashInfer-CUTLASS, public data, HTML canvas report, and Docker runtime.☆13May 24, 2026Updated 5 months ago
- Agent-ready two-node DGX Spark recipe for DeepSeek V4 Flash plus an optional Qwen Vision sidecar, with generic OpenAI-compatible, Hermes,…☆23Aug 10, 2026Updated 3 months ago
- Tencent Hy3 295B MoE (NVFP4) on 2x NVIDIA DGX Spark — TP2 over 200GbE, 256K context, 26 tok/s end-to-end. Tuned, benchmarked, agent-ready…☆14Jul 7, 2026Updated 4 months ago
- Plug-and-play, dependency-free web command center for DGX Spark fleets (and any GPU boxes): live per-node GPU/CPU/mem/temps/power, option…☆48Oct 13, 2026Updated 3 weeks ago
- Capping GPU clocks on NVIDIA GB10: -12C peak temp, -36% GPU power, ~1.6% throughput cost. Measurement harness, raw data, and the systemd …☆78Jul 31, 2026Updated 3 months ago
- DGX Spark / GB10 vLLM Docker stack for large-model serving, presets, patches, and validation notes.☆12Jun 29, 2026Updated 4 months ago
- DeepSeek-V4-Flash-DSpark optimized vLLM 0.26.0 SM121 dual-GB10 evidence (NVFP4 KV, B12X, DSpark K6)☆31Aug 3, 2026Updated 3 months ago
- Live dashboard: fire N parallel streaming coding-agent runs at any OpenAI-compatible endpoint — per-run TTFT/tok-s/E2E, real kill switch,…☆27Jul 23, 2026Updated 3 months ago
- GLM-5.2 NVFP4+AQLM on 3× DGX Spark — 380k context MTP serve stack☆72Aug 2, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Local image generation and editing for NVIDIA DGX Spark, powered by Qwen-Image-2.1 and Gradio.☆33Sep 21, 2026Updated last month
- Mixed-capability LLM benchmark for DGX Spark — 57 scenarios, 10 domains, partial-credit grading, trial statistics☆171Oct 13, 2026Updated 3 weeks ago
- keys-DGX-Sparkticus Utimate Power Pack Unleashed (Dual DGX-Sparks Needed)☆44Aug 23, 2026Updated 2 months ago
- Self-contained DeepSeek V4 Flash DSpark TP=2 recipe for 2x DGX Spark with 62 tok/s benchmark☆24Jul 13, 2026Updated 3 months ago
- CUDA Blackwell performance fork of antirez/ds4 (DeepSeek-V4-Flash): ~4x prefill, ~1.5x decode, continuous batching, weight server, DSpark☆77Oct 26, 2026Updated 2 weeks ago
- Live per-node GPU, host, and vLLM stats for DGX Spark clusters, in your terminal☆17Nov 2, 2026Updated last week
- GLM-5.3-Flash EXL3 (320B MoE) on 2x NVIDIA DGX Spark — production serving kit, 1M context, 97%+ multi-session prefix caching, DFlash2 spe…☆65Nov 4, 2026Updated last week
Are these results useful?