Three-DGX-Spark TP3 serving recipe for GLM-5.3 Flash
☆21Oct 5, 2026Updated last month
Alternatives and similar repositories for jspark3
Users that are interested in jspark3 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Model-agnostic LLM benchmarking + tuning in one command. A model is a 15-key profile file. Built in production on a 4x NVIDIA DGX Spark c…☆10Sep 16, 2026Updated last month
- Eight-system DGX Spark engineering: fabric repair, NCCL tuning, rack recabling, custom 3D-printed PSU supports, and thermal validation.☆11Aug 3, 2026Updated 3 months ago
- Full GLM-5.3 (753B) served by TensorFold with tensor parallel 4 across four NVIDIA DGX Sparks: results, recipe, node settings, benches☆22Oct 13, 2026Updated last month
- keys- 1M context: Inkling-Small-NVFP4 + DSpark + NVFP4 KV on SGLang, sm_121a-optimized on Two DGX Sparks — one-shot agent-executable rec…☆10Aug 17, 2026Updated 2 months ago
- GLM-5.3-Flash (Z.ai) NVFP4 (LibertAI) + NVFP4 KV, 1M context on 2x DGX Spark GB10 — vLLM TP2 recipe, walls ledger, benchmarks, needle to …☆29Aug 31, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- GLM-5.2 QuantTrio TP=4+DCP2 on 4x NVIDIA DGX Spark (GB10) — tuned and measured under a real agent workload. Adaptive MTP, the indexer law…☆20Aug 24, 2026Updated 2 months ago
- A from-scratch CUDA inference engine for 1-6 DGX Sparks (GB10): GLM-5.3, GLM-5.3-Flash and DeepSeek-V4.1-Flash☆70Updated this week
- ☆21Updated this week
- DeepSeek-V4-Flash-0731 tuned on 4x DGX Spark (GB10) at TP=4 — 123.13 tok/s decode. Every variable measured one at a time, with the values…☆13Aug 11, 2026Updated 3 months ago
- GLM-5.3-Flash EXL3 (320B MoE) on 2x NVIDIA DGX Spark — production serving kit, 1M context, 97%+ multi-session prefix caching, DFlash2 spe…☆65Nov 4, 2026Updated last week
- DeepSeek 1017 EXL3 on 3-4 DGX Sparks. TP4 4.0.4: 4,277 tok/s cold prefill; C16 code 331.7 / prose 287.5 native decode sum. Smart CUDA Gra…☆20Nov 4, 2026Updated last week
- Experimental runtime reclamation of GB10 display-reserved memory into ordinary Linux RAM, with guarded driver, local signing, and reboot …☆13Oct 23, 2026Updated 2 weeks ago
- GLM-5.2 744B with a true 4-bit NVFP4 KV cache on 4x DGX Spark: 42 tok/s peak, 317K-token KV pool (+58.6% vs fp8), needle-verified at 250K…☆15Jul 21, 2026Updated 3 months ago
- Reproducible Docker/vLLM deployment, tuning, and benchmarks for DeepSeek V4.1 Flash on a switchless three-node or four-node DGX Spark fab…☆194Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Full GLM-5.3 (753B, Int4-Int8Mix) on 4x NVIDIA DGX Spark, vLLM TP4☆24Oct 13, 2026Updated 3 weeks ago
- Full GLM-5.3 on 4x DGX Spark with kindlingai gr8 (TP4): RigMark prose c1 29.0 -> 40.6 tok/s (+40 %), c4 63.7 -> 76.6☆12Oct 25, 2026Updated 2 weeks ago
- Give DeepSeek V4 Flash eyes. OpenAI-compatible shim + tiny local VLM. Point any harness at one URL and your text-only model accepts image…☆30Aug 9, 2026Updated 3 months ago
- DGX Spark (GB10/sm_121) port: DeepSeek-V4-Flash 159B on one Spark, GLM-5.2 753B across two. Prepacked 2-bit planes + unified-memory fixes…☆20Jul 20, 2026Updated 3 months ago
- DeepSeek-V4.1-Flash-1017 on NVIDIA DGX Sparks with TensorFold + EXL3: TP4 (4 Sparks, 93.6 tok/s, 1M context) and TP2 (2 Sparks, 73 tok/s)…☆163Oct 26, 2026Updated 2 weeks ago
- Userland fan control for NVIDIA DGX Spark, with additive RPM floors, a temperature-based curve, Secure Boot signing, and DKMS support.☆50Oct 29, 2026Updated 2 weeks ago
- A tiered-memory system design for workloads that don't fit in RAM: measure the working set, pin the hot tier, stream the cold tier from f…☆33Nov 4, 2026Updated last week
- DeepSeek-V4-Flash-DSpark optimized vLLM 0.26.0 SM121 dual-GB10 evidence (NVFP4 KV, B12X, DSpark K6)☆31Aug 3, 2026Updated 3 months ago
- Connect AI agents to 1,400+ APIs across search, social, SEO, finance, and more. Automatic tool discovery, unified billing, zero subscript…☆13Oct 27, 2026Updated 2 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Build, load, and verify NCCL for switchless DGX Spark RoCE cycles☆21Oct 25, 2026Updated 2 weeks ago
- Reproducible kit to deploy DeepSeek-V4-Flash-DSpark on a 2× NVIDIA DGX Spark (GB10) cluster: vLLM TP=2 over QSFP 200GbE, NVFP4 KV, DSpark…☆13Aug 24, 2026Updated 2 months ago
- Optimized two-node DGX Spark deployment recipe for DeepSeek V4 Flash with vLLM, DSpark, and NVFP4 KV cache☆11Aug 12, 2026Updated 3 months ago
- GLM-5.3-Flash NVFP4 on 4x NVIDIA DGX Spark: vLLM TP4, DFlash2 adaptive draft, measured FP8 vs NVFP4 vs EXL3 vs SGLang☆44Sep 29, 2026Updated last month
- Tuned TP4 serving profile for DeepSeek-V4.1-Flash on 4x NVIDIA DGX Spark (SGLang, DSpark), built on the MiaAI-Lab recipe☆95Updated this week
- Give the DeepSeek Harness (dsh) eyes with any text model + any vision model: a vision proxy for chat image attachments and an analyze_ima…☆12Sep 28, 2026Updated last month
- ☆16Sep 25, 2026Updated last month
- Serve Qwen3.8-Flash-Next (turboderp ExLlamaV3 pack) on one NVIDIA DGX Spark with exllamav3☆65Oct 14, 2026Updated 3 weeks ago
- qwen38-flash-next recipe for tp=2 GB10☆135Oct 29, 2026Updated 2 weeks ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Autonomous self-improving 4x DGX Spark (GB10) MoA stack + LoRA loop (DSV4F router, Qwen3.6/Omni/TwoTower/Gemma). Hermes MoA routing, ~90%…☆24Aug 17, 2026Updated 2 months ago
- Run DeepSeek-V4-Flash at full 1M context AND two MiniMax H3 video instances on the same two DGX Sparks. Benchmarked C1-C6.☆36Aug 7, 2026Updated 3 months ago
- MiMo-V2.5 NVFP4 4-bit weights + NVFP4 4-bit KV cache + DFlash speculative decoding on 2× NVIDIA DGX Spark — 1M context, 3.4M-token KV poo…☆18Jul 13, 2026Updated 4 months ago
- EXLR8: a DGX Spark tuned quantization format☆14Updated this week
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆12Oct 28, 2026Updated 2 weeks ago
- GLM-5.2 NVFP4+AQLM on 3× DGX Spark — 380k context MTP serve stack☆72Aug 2, 2026Updated 3 months ago
- GLM-5.3-Flash (NVFP4) at TP4 across 4x DGX Spark via a switchless RoCE ring + DFlash2 — reproducible recipe☆112Oct 25, 2026Updated 2 weeks ago
Are these results useful?