Exact SGLang runtime for GLM-5.3-Flash-NVFP4 on 4x RTX PRO 6000 Blackwell (SM120): flashinfer_cutlass MoE, DSA+KDA attention, NEXTN MTP5, six baked SM120 patches
☆17Aug 27, 2026Updated 2 months ago
Alternatives and similar repositories for glm-5.3-flash-sglang-sm120
Users that are interested in glm-5.3-flash-sglang-sm120 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆14Aug 12, 2026Updated 3 months ago
- Agent-ready two-node DGX Spark recipe for DeepSeek V4 Flash plus an optional Qwen Vision sidecar, with generic OpenAI-compatible, Hermes,…☆23Aug 10, 2026Updated 3 months ago
- GLM-5.2 QuantTrio TP=4+DCP2 on 4x NVIDIA DGX Spark (GB10) — tuned and measured under a real agent workload. Adaptive MTP, the indexer law…☆20Aug 24, 2026Updated 2 months ago
- ☆12Aug 19, 2026Updated 2 months ago
- Serve LibertAIDAI/GLM-5.3-Flash-NVFP4 on 2x NVIDIA DGX Spark (GB10) with patched vLLM TP=2, 262k context, MTP-4.☆21Nov 2, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆21Aug 17, 2026Updated 2 months ago
- Model-agnostic LLM benchmarking + tuning in one command. A model is a 15-key profile file. Built in production on a 4x NVIDIA DGX Spark c…☆10Sep 16, 2026Updated last month
- Index / recipe book for every GLM-5.3 (and GLM-5.2 foundation) serving recipe on NVIDIA DGX Spark (GB10): Flash + big 743B, TP2 + TP4, ev…☆14Aug 29, 2026Updated 2 months ago
- Qwen3.8-27B on one DGX Spark GB10: DFlash 2 for 65 tok/s C1 and 120 C4; EAGLE 3/1/4 for ~191 C8, ~330 C16 and ~535 C32; native 262K, pinn…☆13Oct 6, 2026Updated last month
- ☆13Aug 27, 2026Updated 2 months ago
- Optimized two-node DGX Spark deployment recipe for DeepSeek V4 Flash with vLLM, DSpark, and NVFP4 KV cache☆11Aug 12, 2026Updated 3 months ago
- Small implementation of the paper TiDAR: Think in Diffusion, Talk in Autoregression☆22Dec 26, 2025Updated 10 months ago
- Local model hosting with 2x DGX Sparks☆12Aug 29, 2026Updated 2 months ago
- Unpruned GLM-5.2 (744B) at 1M context on 4x DGX Spark (GB10/sm_121a) — NVFP4 compact-KV + B12X sparse-MLA + MTP-5. Tested, stable, honest…☆11Aug 15, 2026Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- DeepSeek V4.1 Flash on 4x RTX PRO 6000 Blackwell: native weights, DSpark, vision, NVMe or locked RAM Engram offload.☆91Oct 17, 2026Updated 3 weeks ago
- DeepSeek-V4-Flash-0731 tuned on 4x DGX Spark (GB10) at TP=4 — 123.13 tok/s decode. Every variable measured one at a time, with the values…☆13Aug 11, 2026Updated 3 months ago
- ☆27Aug 19, 2026Updated 2 months ago
- Validated vLLM recipe: Qwen3.8-27B-NVFP4 at full 262,144-token context on a single RTX 5090, GPU-only (no CPU offload).☆16Aug 20, 2026Updated 2 months ago
- ☆13May 1, 2026Updated 6 months ago
- This plugin provides some extra channel settings in admin.☆13Oct 9, 2026Updated last month
- First Int4-Int8Mix quantization of the full GLM-5.3 (743B), served on 4x NVIDIA DGX Spark (GB10) at TP4. Quantizer, verification gates, a…☆21Oct 6, 2026Updated last month
- A community-owned map of LLM inference engine configurations — benchmarks, evals and coverage gaps, hosted on GitHub Pages. The repo is t…☆16Oct 19, 2026Updated 3 weeks ago
- GLM 5.3 Flash for 2x RTX 6000, Full Mixed EXL3 Support, Code C1 >220tps☆22Oct 25, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Serving Qwen3.8-27B-FP8 on a single DGX Spark (GB10): 7.88 to 58.5 tok/s single-stream from decode strategy alone, weights untouched. Spe…☆56Sep 29, 2026Updated last month
- CLI for managing OpenHome voice AI abilities — deploy, validate, and scaffold from your terminal☆12Jun 24, 2026Updated 4 months ago
- Browse, search, resume and manage your AI coding sessions in one local desktop app. (Claude Code, Codex, Gemini,OpenCode, Cursor, kimi)☆20Oct 20, 2026Updated 3 weeks ago
- Personal skills 🤖☆19Updated this week
- Navigate between Mardown headings with ease from within Neovim.☆12Jul 11, 2026Updated 4 months ago
- A tool that converts scientific PDFs into plain text for your LLM-related needs, such as building RAGs or agents for academic knowledge. …☆26Feb 28, 2024Updated 2 years ago
- Validated GLM-5.3 Flash recipe for 2x NVIDIA RTX PRO 6000 Blackwell 96GB: 262K context, EXL3/TR3, adaptive MTP, tools, and vision.☆63Sep 20, 2026Updated last month
- ☆12Jan 22, 2026Updated 9 months ago
- ☆10Nov 28, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- GLM-5.2 on 4x DGX Spark with adaptive MTP K2/K4/K5, FULL CUDA graphs, DCP2, 520K context, and a downloadable ARM64 runtime image.☆13Aug 8, 2026Updated 3 months ago
- Serving DeepSeek-V4-Flash-0731-NVFP4 on 2x RTX PRO 6000 Blackwell (sm_120): vLLM patches, tuned configs, serve scripts, benchmarks☆15Aug 25, 2026Updated 2 months ago
- Reverse engineering toolkit for Apple Silicon private APIs. 55+ Apple Intelligence models mapped, Metal 4 ML pipeline, 1009 IOReport chan…☆19Mar 26, 2026Updated 7 months ago
- DeepSeek-V4.1-Flash EXL3 on 2x DGX Spark (GB10) with the TensorFold engine, TP=2☆13Oct 10, 2026Updated last month
- ☆10Sep 10, 2023Updated 3 years ago
- GLM-5.3-Flash (FP8) + DFlash2 speculative decoding on 4x NVIDIA DGX Spark / ASUS GX10: vLLM TP4, 256K context, switchless ConnectX-7 ring…☆30Oct 1, 2026Updated last month
- ☆54Oct 18, 2026Updated 3 weeks ago
Are these results useful?