Native DeepSeek V4.1 Flash inference across one RTX PRO 6000 and four DGX Spark expert workers
☆40Sep 25, 2026Updated last month
Alternatives and similar repositories for ds41rt
Users that are interested in ds41rt are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- English guide + one-command patcher for the vLLM spin-wait bug that overheats NVIDIA DGX Spark / GB10. Credit: nacyot. CPU cores spin at …☆24Aug 17, 2026Updated 2 months ago
- Validated vLLM recipe: Qwen3.8-27B-NVFP4 at full 262,144-token context on a single RTX 5090, GPU-only (no CPU offload).☆16Aug 20, 2026Updated 2 months ago
- GLM-5.2 on 4x DGX Spark with adaptive MTP K2/K4/K5, FULL CUDA graphs, DCP2, 520K context, and a downloadable ARM64 runtime image.☆13Aug 8, 2026Updated 3 months ago
- GLM-5.3-Flash EXL3 (320B MoE) on 2x NVIDIA DGX Spark — production serving kit, 1M context, 97%+ multi-session prefix caching, DFlash2 spe…☆65Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆47Oct 27, 2026Updated last week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Recipe: GLM-5.2 (unpruned QuantTrio Int4-Int8Mix) at 200K ctx with MTP spec decode on a 4x NVIDIA DGX Spark (GB10) cluster☆77Jul 25, 2026Updated 3 months ago
- GLM-5.2 (744B/40B MoE) on a 4× DGX Spark / GB10 (sm_121) cluster: portable Triton sparse-MLA kernels, a data-free expert prune, MTP draft…☆37Aug 20, 2026Updated 2 months ago
- Serve LibertAIDAI/GLM-5.3-Flash-NVFP4 on 2x NVIDIA DGX Spark (GB10) with patched vLLM TP=2, 262k context, MTP-4.☆21Updated this week
- Fast, capable GLM-5.3-Flash FP4-Local on two DGX Sparks: opinionated Atlas serving and reproducible inference research.☆72Updated this week
- A self-hosted control plane for a DGX Spark GPU cluster: provision nodes over SSH or a join token, deploy and serve inference behind one …☆13Oct 23, 2026Updated 2 weeks ago
- ☆21Sep 28, 2026Updated last month
- Docker compose serving stack for DeepSeek v4 Flash DSpark for NVIDIA Spark GB10 system using Aidendle94 image☆33Aug 30, 2026Updated 2 months ago
- DeepSeek-V4-Flash-0731 tuned on 4x DGX Spark (GB10) at TP=4 — 123.13 tok/s decode. Every variable measured one at a time, with the values…☆13Aug 11, 2026Updated 2 months ago
- MiMo-V2.5 Omni TP=2 on 2x DGX Spark · 1M context · NVFP4 4-bit KV (~1.97M-token KV pool @ 1M, ~30 tok/s) · 69-eval: thinking-OFF 97.8 bea…☆39Jul 13, 2026Updated 3 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆791Updated this week
- Terminal system monitor (TUI) that builds its layout from the hardware it actually finds — hybrid CPU clusters, GPUs, RDMA/RoCE NICs, PCI…☆17Updated this week
- 3D models for DGX cases☆55Aug 14, 2026Updated 2 months ago
- GLM-5.3-Flash (NVFP4) at TP4 across 4x DGX Spark via a switchless RoCE ring + DFlash2 — reproducible recipe☆111Oct 25, 2026Updated 2 weeks ago
- Minimal read-only OS image for GB10 (DGX Spark / ASUS GX10) boxes☆97Nov 1, 2026Updated last week
- Stackable, modular, 3D-printable rack for the NVIDIA DGX Spark. ABS/ASA, panels, CC BY-NC-SA 4.0.☆18Oct 8, 2026Updated last month
- Archived: b12x development has moved to FlashInfer. See README for migration and PR-porting guidance.☆270Oct 6, 2026Updated last month
- GLM-5.3-Flash NVFP4 on 4x NVIDIA DGX Spark: vLLM TP4, DFlash2 adaptive draft, measured FP8 vs NVFP4 vs EXL3 vs SGLang☆42Sep 29, 2026Updated last month
- Serve EXL3 (ExLlamaV3 trellis) quantized models on vLLM fork runtimes — any architecture, mixed per-layer bitrates, composable with sourc…☆27Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Recipe: GLM-5.2 (unpruned QuantTrio Int4-Int8Mix) at 655,360-token context + MTP spec decode (DCP4, fp8_ds_mla) on a 4x NVIDIA DGX Spark …☆32Jul 13, 2026Updated 3 months ago
- OpenAI-compatible inference server for 4-bit Qwen3.8-27B on one RTX 3090, 262K context☆34Oct 29, 2026Updated last week
- Full GLM-5.3 (753B, Int4-Int8Mix) on 4x NVIDIA DGX Spark, vLLM TP4☆23Oct 13, 2026Updated 3 weeks ago
- AEON vLLM Ultimate — vLLM 0.27.1 built from source for DGX Spark / Blackwell (sm_121a/GB10). DSpark quantized Markov heads, DFlash SWA on…☆149Oct 6, 2026Updated last month
- ☆32Nov 2, 2026Updated last week
- MRS-Core provides a transparent, modular, reproducible reasoning substrate.☆11Feb 3, 2026Updated 9 months ago
- Two-node DGX Spark/ASUS GX10 DeepSeek V4 Flash DSpark NVFP4 port for vLLM 0.25, with live dashboard and reproducible deployment.☆84Oct 27, 2026Updated last week
- ☆17Jun 17, 2026Updated 4 months ago
- MiniMax M2.7 NVFP4 dual-GB10 Blackwell benchmark: vLLM FlashInfer-CUTLASS, public data, HTML canvas report, and Docker runtime.☆13May 24, 2026Updated 5 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Tool-calling quality benchmark for LLM serving stacks. 80+ deterministic scenarios testing multi-turn orchestration, safety boundaries, a…☆417Updated this week
- GLM-5.2 QuantTrio TP=4+DCP2 on 4x NVIDIA DGX Spark (GB10) — tuned and measured under a real agent workload. Adaptive MTP, the indexer law…☆20Aug 24, 2026Updated 2 months ago
- Fork of Synergy that allows for support of Chrome OS/Android using an HID☆10Mar 13, 2019Updated 7 years ago
- DGX Spark (GB10/sm_121) port: DeepSeek-V4-Flash 159B on one Spark, GLM-5.2 753B across two. Prepacked 2-bit planes + unified-memory fixes…☆19Jul 20, 2026Updated 3 months ago
- Qwen3.8-27B on 2× RTX 5090 · 1.49M KV · code/prose t/s: c1 264/216, c16 2,649/2,240 · NVFP4 + vLLM + MTP☆26Oct 21, 2026Updated 2 weeks ago
- qwen38-flash-next recipe for tp=2 GB10☆133Oct 29, 2026Updated last week
- Homomorphic Encryption Randomness Beacon☆13Dec 3, 2019Updated 6 years ago