GLM-5.3-Flash EXL3 (320B MoE) on 2x NVIDIA DGX Spark — production serving kit, 1M context, 97%+ multi-session prefix caching, DFlash2 spec decode
☆64Nov 4, 2026Updated this week
Alternatives and similar repositories for glm53-flash-exl3-2x-dgx-spark
Users that are interested in glm53-flash-exl3-2x-dgx-spark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- GLM-5.3-Flash (abliterated EXL3) on 2x NVIDIA DGX Spark with the TensorFold engine: 1.8x faster decode than vLLM, 4x256k concurrent threa…☆121Oct 30, 2026Updated last week
- Agent-ready two-node DGX Spark recipe for DeepSeek V4 Flash plus an optional Qwen Vision sidecar, with generic OpenAI-compatible, Hermes,…☆23Aug 10, 2026Updated 2 months ago
- DeepSeek-V4.1-Flash on 2x NVIDIA DGX Spark with the TensorFold engine: 1.8-1.9x code, 2.5x multi-stream, 1.7-1.95x prefill vs the vLLM ki…☆133Updated this week
- Give DeepSeek V4 Flash eyes. OpenAI-compatible shim + tiny local VLM. Point any harness at one URL and your text-only model accepts image…☆30Aug 9, 2026Updated 2 months ago
- qwen38-flash-next recipe for tp=2 GB10☆133Oct 29, 2026Updated last week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- GLM-5.3-Flash (NVFP4) at TP=4 across 4x ASUS GX10 / GB10 - vLLM + mentat instead of Ray, 524k context, DFlash2. Minimal working recipe.☆94Updated this week
- GLM-5.3-Flash (Z.ai) NVFP4 (LibertAI) + NVFP4 KV, 1M context on 2x DGX Spark GB10 — vLLM TP2 recipe, walls ledger, benchmarks, needle to …☆29Aug 31, 2026Updated 2 months ago
- GLM-5.3 Flash EXL3 for 2-4x DGX Sparks☆749Updated this week
- Model-agnostic LLM benchmarking + tuning in one command. A model is a 15-key profile file. Built in production on a 4x NVIDIA DGX Spark c…☆10Sep 16, 2026Updated last month
- ☆13Aug 27, 2026Updated 2 months ago
- Qwen3.8-Flash-Next-NVFP4-vLLM-Dual-DGX-Spark☆412Sep 29, 2026Updated last month
- Three-DGX-Spark TP3 serving recipe for GLM-5.3 Flash☆21Oct 5, 2026Updated last month
- GLM-5.2 QuantTrio TP=4+DCP2 on 4x NVIDIA DGX Spark (GB10) — tuned and measured under a real agent workload. Adaptive MTP, the indexer law…☆20Aug 24, 2026Updated 2 months ago
- A from-scratch CUDA inference engine for 1-6 DGX Sparks (GB10): GLM-5.3, GLM-5.3-Flash and DeepSeek-V4.1-Flash☆62Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- vLLM inference solutions for NVIDIA GB10 (DGX Spark, sm121) — KIMI-K3 B12X_MLA + DSpark, GLM-5.2☆69Sep 30, 2026Updated last month
- Optimized two-node DGX Spark deployment recipe for DeepSeek V4 Flash with vLLM, DSpark, and NVFP4 KV cache☆11Aug 12, 2026Updated 2 months ago
- DeepSeek-V4-Flash-0731 tuned on 4x DGX Spark (GB10) at TP=4 — 123.13 tok/s decode. Every variable measured one at a time, with the values…☆13Aug 11, 2026Updated 2 months ago
- DeepSeek v4.1 Flash EXL3 2.9 bpw for 2x DGX Sparks☆280Sep 19, 2026Updated last month
- Capping GPU clocks on NVIDIA GB10: -12C peak temp, -36% GPU power, ~1.6% throughput cost. Measurement harness, raw data, and the systemd …☆78Jul 31, 2026Updated 3 months ago
- Validated vLLM recipe: Qwen3.8-27B-NVFP4 at full 262,144-token context on a single RTX 5090, GPU-only (no CPU offload).☆16Aug 20, 2026Updated 2 months ago
- Serve LibertAIDAI/GLM-5.3-Flash-NVFP4 on 2x NVIDIA DGX Spark (GB10) with patched vLLM TP=2, 262k context, MTP-4.☆21Updated this week
- DGX Spark EC fan speed override / rollback tool☆25Aug 23, 2026Updated 2 months ago
- GLM-5.3-Flash EXL3 on 2x DGX Spark with TensorFold☆528Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Fast, capable GLM-5.3-Flash FP4-Local on two DGX Sparks: opinionated Atlas serving and reproducible inference research.☆72Updated this week
- Userland fan control for NVIDIA DGX Spark, with additive RPM floors, a temperature-based curve, Secure Boot signing, and DKMS support.☆47Oct 29, 2026Updated last week
- Recover usable memory on DGX Spark with a 64 KiB kernel: an opt-in NVIDIA UVM page-table packing patch, build tools, and measured validat…☆39Oct 16, 2026Updated 3 weeks ago
- Tuned TP4 serving profile for DeepSeek-V4.1-Flash on 4x NVIDIA DGX Spark (SGLang, DSpark), built on the MiaAI-Lab recipe☆89Updated this week
- Qwen 3.8 Flash NVFP4 with PLE NVFP4 quantized to run on a single DGX Spark☆15Aug 28, 2026Updated 2 months ago
- GLM-5.3-Flash (NVFP4) at TP4 across 4x DGX Spark via a switchless RoCE ring + DFlash2 — reproducible recipe☆111Oct 25, 2026Updated last week
- Switchless RoCE collectives, NCCL profiles and fabric tooling for DGX Spark inference recipes☆41Updated this week
- Full GLM-5.3 (753B) served by TensorFold with tensor parallel 4 across four NVIDIA DGX Sparks: results, recipe, node settings, benches☆22Oct 13, 2026Updated 3 weeks ago
- Run DeepSeek-V4-Flash at full 1M context AND two MiniMax H3 video instances on the same two DGX Sparks. Benchmarked C1-C6.☆35Aug 7, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Free, keyless web_search and web_fetch for the DeepSeek Harness (dsh) — DuckDuckGo-backed, no signup. Unofficial community project.☆18Sep 28, 2026Updated last month
- Full GLM-5.3 (753B, Int4-Int8Mix) on 4x NVIDIA DGX Spark, vLLM TP4☆23Oct 13, 2026Updated 3 weeks ago
- LLM engine with adaptive expert loading. DeepSeek V4.1 Flash (510 GB) on two DGX Sparks at its released MXFP4 weights.Or GLM 5.3 full EXL…☆33Updated this week
- DeepSeek-v4-Flash 0731 recipe for 2x DGX Sparks☆1,512Oct 4, 2026Updated last month
- GLM-5.3-Flash (320B MoE) at TP4 across four DGX Sparks, same day as the model drop: 36 tok/s, 1.26M-token FP8 KV pool, 262K context, MTP …☆57Oct 10, 2026Updated 3 weeks ago
- BertholomusAI recipe: DeepSeek-V4.1-Flash-1017 on 2x NVIDIA DGX Spark (GB10), our own TensorFold TP2 engine. Weights: bertholomus EXL3 2.…☆64Updated this week
- DeepSeek-V4.1-Flash on 3-4x NVIDIA DGX Sparks☆288Oct 17, 2026Updated 3 weeks ago