GLM-5.3-Flash (FP8) + DFlash2 speculative decoding on 4x NVIDIA DGX Spark / ASUS GX10: vLLM TP4, 256K context, switchless ConnectX-7 ring with patched NCCL
☆30Oct 1, 2026Updated 2 weeks ago
Alternatives and similar repositories for GLM-5.3-Flash-FP8-4-DGX-Spark-Switchless
Users that are interested in GLM-5.3-Flash-FP8-4-DGX-Spark-Switchless are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Full GLM-5.3 (753B, Int4-Int8Mix) on 4x NVIDIA DGX Spark, vLLM TP4☆23Oct 13, 2026Updated last week
- GLM-5.3 (full) on 3-6 DGX Sparks (GB10): a from-scratch CUDA inference engine☆38Updated this week
- Full GLM-5.3 (753B) served by TensorFold with tensor parallel 4 across four NVIDIA DGX Sparks: results, recipe, node settings, benches☆21Oct 13, 2026Updated last week
- GLM-5.3-Flash (NVFP4) at TP4 across 4x DGX Spark via a switchless RoCE ring + DFlash2 — reproducible recipe☆107Updated this week
- Terminal system monitor (TUI) that builds its layout from the hardware it actually finds — hybrid CPU clusters, GPUs, RDMA/RoCE NICs, PCI…☆17Aug 1, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- GLM-5.3-Flash NVFP4 on two or four DGX Sparks cabled as a ring, with no switch: the RiNGSiDE serving recipe☆30Sep 27, 2026Updated 3 weeks ago
- Serve LibertAIDAI/GLM-5.3-Flash-NVFP4 on 2x NVIDIA DGX Spark (GB10) with patched vLLM TP=2, 262k context, MTP-4.☆21Updated this week
- GLM-5.3-Flash (NVFP4) at TP=4 across 4x ASUS GX10 / GB10 - vLLM + mentat instead of Ray, 524k context, DFlash2. Minimal working recipe.☆90Updated this week
- Tuned TP4 serving profile for DeepSeek-V4.1-Flash on 4x NVIDIA DGX Spark (SGLang, DSpark), built on the MiaAI-Lab recipe☆57Oct 12, 2026Updated last week
- Build, load, and verify NCCL for switchless DGX Spark RoCE cycles☆19Sep 25, 2026Updated 3 weeks ago
- Ubuntu 24.04 + NVIDIA stack setup guide for GB10 / DGX Spark systems☆24Sep 22, 2026Updated 3 weeks ago
- Tile primitives for speedy kernels☆21Sep 13, 2026Updated last month
- GLM-5.3-Flash NVFP4 on 4x NVIDIA DGX Spark: vLLM TP4, DFlash2 adaptive draft, measured FP8 vs NVFP4 vs EXL3 vs SGLang☆39Sep 29, 2026Updated 3 weeks ago
- Switchless RoCE collectives, NCCL profiles and fabric tooling for DGX Spark inference recipes☆37Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Low-latency collective transport and distributed LLM serving stack for switchless GB10 clusters.☆94Updated this week
- Native DeepSeek V4.1 Flash inference across one RTX PRO 6000 and four DGX Spark expert workers☆36Sep 25, 2026Updated 3 weeks ago
- GLM-5.3-Flash (EXL3 4bpw + DFlash2) on 2x NVIDIA DGX Spark: one-shot installer, 33-74 tok/s c1, 1.3M+ context, vision☆43Sep 2, 2026Updated last month
- Repo to collect the things I do to practice with Istio☆12Dec 15, 2023Updated 2 years ago
- RigMark benchmarks local AI the way coding agents actually use it.☆25Updated this week
- Minimal read-only OS image for GB10 (DGX Spark / ASUS GX10) boxes☆90Oct 4, 2026Updated 2 weeks ago
- DeepSeek-V4.1-Flash (552B MoE, MXFP4 experts, 1M ctx) on four NVIDIA DGX Sparks with vLLM TP4: Engram-on-disk patch, sm121 kernel build, …☆134Updated this week
- Multi-arch templates for OpenFaaS☆12Sep 11, 2020Updated 6 years ago
- The Plunder chest is virtual environment for developing and testing deployment tooling☆15Jan 8, 2021Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- One script to install, run, update, and maintain ComfyUI on the NVIDIA DGX Spark (GB10 Grace Blackwell).☆76Oct 10, 2026Updated last week
- Best-of-N coding agents with LLM-as-a-Verifier selection for Oh My Pi: isolated git worktrees, verifier-ranked trajectories, winner-only …☆74Oct 1, 2026Updated 2 weeks ago
- GLM-5.3 Flash EXL3 for 2-4x DGX Sparks☆737Updated this week
- GLM-5.3-Flash EXL3 2.05 on one DGX Spark — TP1 vLLM, DFlash2 K5, concurrency, 262K context, and published fidelity measurements☆53Sep 22, 2026Updated 3 weeks ago
- Raspberry Pi Kubernetes Lab☆13Dec 17, 2019Updated 6 years ago
- Terraform IAC for K3S on AWS☆17Oct 23, 2020Updated 5 years ago
- ☆24Sep 25, 2025Updated last year
- DGX Spark (GB10) random hard power-off: how to diagnose the log-less crash signature and stop it with a GPU clock cap. Field-tested fix +…☆25Aug 16, 2026Updated 2 months ago
- GLM-5.3-Flash EXL3 on 2x DGX Spark with TensorFold☆469Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆15Sep 14, 2026Updated last month
- DeepSeek-V4.1-Flash on 3-4x NVIDIA DGX Sparks☆263Updated this week
- Fast, capable GLM-5.3-Flash FP4-Local on two DGX Sparks: opinionated Atlas serving and reproducible inference research.☆64Updated this week
- CLI for actuated☆26Aug 21, 2026Updated 2 months ago
- 1.0 Beta · oMLX 0.6.3rc2 Dual-ANE+CPU · Qwen3.8-27B abliterated oQ4e · Mac Studio M3 Ultra☆45Aug 23, 2026Updated last month
- Generate and execute fuzzing campaign commands for AFL++ based on the recommended multi-core secondary fuzzer options.☆11Jan 12, 2024Updated 2 years ago
- DeepSeek-V4.1-Flash on two NVIDIA DGX Sparks: EXL3 weights from the official checkpoint, upstream vLLM with our patches and decode kernel…☆40Updated this week