First Int4-Int8Mix quantization of the full GLM-5.3 (743B), served on 4x NVIDIA DGX Spark (GB10) at TP4. Quantizer, verification gates, and serving recipe.
☆21Oct 6, 2026Updated last month
Alternatives and similar repositories for GLM-5.3-Int4-Int8Mix-TP4-4x-DGX-Spark
Users that are interested in GLM-5.3-Int4-Int8Mix-TP4-4x-DGX-Spark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Full GLM-5.3 (753B, Int4-Int8Mix) on 4x NVIDIA DGX Spark, vLLM TP4☆24Oct 13, 2026Updated last month
- Full GLM-5.3 (753B) served by TensorFold with tensor parallel 4 across four NVIDIA DGX Sparks: results, recipe, node settings, benches☆22Oct 13, 2026Updated last month
- Index / recipe book for every GLM-5.3 (and GLM-5.2 foundation) serving recipe on NVIDIA DGX Spark (GB10): Flash + big 743B, TP2 + TP4, ev…☆14Aug 29, 2026Updated 2 months ago
- ☆13Aug 27, 2026Updated 2 months ago
- Full GLM-5.3 on 4x DGX Spark with kindlingai gr8 (TP4): RigMark prose c1 29.0 -> 40.6 tok/s (+40 %), c4 63.7 -> 76.6☆13Oct 25, 2026Updated 2 weeks ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- DeepSeek V4 Flash DSpark DGX Spark TP4 Ring 生产调优与算子工程归档 (LuZ0.4.5)☆17Sep 11, 2026Updated 2 months ago
- Experimental runtime reclamation of GB10 display-reserved memory into ordinary Linux RAM, with guarded driver, local signing, and reboot …☆13Oct 23, 2026Updated 3 weeks ago
- A from-scratch CUDA inference engine for 1-6 DGX Sparks (GB10): GLM-5.3, GLM-5.3-Flash and DeepSeek-V4.1-Flash☆79Updated this week
- Minimal read-only OS image for GB10 (DGX Spark / ASUS GX10) boxes☆97Updated this week
- Low-latency collective transport and distributed LLM serving stack for switchless GB10 clusters.☆105Nov 2, 2026Updated last week
- GLM-5.3-Flash NVFP4 on 4x NVIDIA DGX Spark: vLLM TP4, DFlash2 adaptive draft, measured FP8 vs NVFP4 vs EXL3 vs SGLang☆44Sep 29, 2026Updated last month
- GLM-5.3-Flash (NVFP4) at TP=4 across 4x ASUS GX10 / GB10 - vLLM + mentat instead of Ray, 524k context, DFlash2. Minimal working recipe.☆96Nov 6, 2026Updated last week
- Fan Shroud for the Spark platform, for improved cooling performance on long workloads. Full STL/STEP files + electronics schematics☆45Sep 22, 2026Updated last month
- ☆37Nov 2, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- GLM-5.2 QuantTrio TP=4+DCP2 on 4x NVIDIA DGX Spark (GB10) — tuned and measured under a real agent workload. Adaptive MTP, the indexer law…☆20Aug 24, 2026Updated 2 months ago
- DeepSeek-V4.1-Flash-1017 on NVIDIA DGX Sparks with TensorFold + EXL3: TP4 (4 Sparks, 93.6 tok/s, 1M context) and TP2 (2 Sparks, 73 tok/s)…☆164Oct 26, 2026Updated 2 weeks ago
- Recipe: GLM-5.2 (unpruned QuantTrio Int4-Int8Mix) at 655,360-token context + MTP spec decode (DCP4, fp8_ds_mla) on a 4x NVIDIA DGX Spark …☆32Jul 13, 2026Updated 4 months ago
- Serve LibertAIDAI/GLM-5.3-Flash-NVFP4 on 2x NVIDIA DGX Spark (GB10) with patched vLLM TP=2, 262k context, MTP-4.☆21Nov 2, 2026Updated last week
- DeepSeek-V4.1-Flash on 4x DGX Spark TP4 switchless RoCE ring - SGLang production recipe, 600K context, DSpark MTP, benchmark archive☆30Oct 1, 2026Updated last month
- GLM-5.3-Flash (NVFP4) at TP4 across 4x DGX Spark via a switchless RoCE ring + DFlash2 — reproducible recipe☆112Oct 25, 2026Updated 2 weeks ago
- GLM-5.3-Flash NVFP4 on two or four DGX Sparks cabled as a ring, with no switch: the RiNGSiDE serving recipe☆30Sep 27, 2026Updated last month
- DeepSeek-V4.1-Flash on 3-4x NVIDIA DGX Sparks☆297Oct 17, 2026Updated 3 weeks ago
- Tuned TP4 serving profile for DeepSeek-V4.1-Flash on 4x NVIDIA DGX Spark (SGLang, DSpark), built on the MiaAI-Lab recipe☆95Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- DGX Spark EC fan speed override / rollback tool☆25Aug 23, 2026Updated 2 months ago
- W4A4 full（VLLM_MOE_W4A4=2）+ （VLLM_B12X_SHARED_WRAPPER=1）+ FlashInfer 0.6.16 + threshold 4096 + util 0.78 + DSpark MTP n7 + CUMEM=0☆16Aug 26, 2026Updated 2 months ago
- Model-agnostic LLM benchmarking + tuning in one command. A model is a 15-key profile file. Built in production on a 4x NVIDIA DGX Spark c…☆10Sep 16, 2026Updated last month
- GLM-5.3-Flash EXL3 (320B MoE) on 2x NVIDIA DGX Spark — production serving kit, 1M context, 97%+ multi-session prefix caching, DFlash2 spe…☆65Nov 4, 2026Updated last week
- ☆12Jul 13, 2026Updated 4 months ago
- Android JNI runtime-risk detector for root, hooks, Frida, suspicious memory mappings, ART/Zygote side effects, disk/process/port artifact…☆15Updated this week
- GLM-5.3 EXL3 on DGX Sparks with TensorFold☆83Oct 4, 2026Updated last month
- Optimized two-node DGX Spark deployment recipe for DeepSeek V4 Flash with vLLM, DSpark, and NVFP4 KV cache☆11Aug 12, 2026Updated 3 months ago
- GLM-5.3-Flash (NVFP4) on 2x NVIDIA DGX Spark - vLLM TP2, 262K context, MTP. World-first deploy recipe: 7 day-0 bugs found and fixed, patc…☆243Sep 30, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Local model hosting with 2x DGX Sparks☆12Aug 29, 2026Updated 2 months ago
- GLM 5.3 Flash for 2x RTX 6000, Full Mixed EXL3 Support, Code C1 >220tps☆22Oct 25, 2026Updated 2 weeks ago
- Exact SGLang runtime for GLM-5.3-Flash-NVFP4 on 4x RTX PRO 6000 Blackwell (SM120): flashinfer_cutlass MoE, DSA+KDA attention, NEXTN MTP5,…☆17Aug 27, 2026Updated 2 months ago
- terminal ui mojo programming language☆12Mar 11, 2026Updated 8 months ago
- A personal guide and resource collection for setting up OnePlus Pad 3 aka Pad 2 Pro.☆15Jun 23, 2026Updated 4 months ago
- Serving 4-bit Qwen3.8-27B on a single DGX Spark (GB10): 75 tok/s single-stream, 246 tok/s aggregate at 8-way concurrency. NVFP4 vs MixedI…☆51Sep 29, 2026Updated last month
- Safe and idiomatic SQLite binding for Mojo🔥 with ORM support☆13Nov 7, 2026Updated last week
Are these results useful?