A from-scratch CUDA inference engine for 1-6 DGX Sparks (GB10): GLM-5.3, GLM-5.3-Flash and DeepSeek-V4.1-Flash
☆62Nov 7, 2026Updated this week
Alternatives and similar repositories for gr8
Users that are interested in gr8 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- GLM-5.3-Flash (NVFP4) at TP=4 across 4x ASUS GX10 / GB10 - vLLM + mentat instead of Ray, 524k context, DFlash2. Minimal working recipe.☆94Updated this week
- Full GLM-5.3 (753B) served by TensorFold with tensor parallel 4 across four NVIDIA DGX Sparks: results, recipe, node settings, benches☆22Oct 13, 2026Updated 3 weeks ago
- Three-DGX-Spark TP3 serving recipe for GLM-5.3 Flash☆21Oct 5, 2026Updated last month
- Full GLM-5.3 (753B, Int4-Int8Mix) on 4x NVIDIA DGX Spark, vLLM TP4☆23Oct 13, 2026Updated 3 weeks ago
- A very-low-resource API-compatible replacement for Ray☆13Nov 1, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Tuned TP4 serving profile for DeepSeek-V4.1-Flash on 4x NVIDIA DGX Spark (SGLang, DSpark), built on the MiaAI-Lab recipe☆89Updated this week
- Switchless RoCE collectives, NCCL profiles and fabric tooling for DGX Spark inference recipes☆41Updated this week
- Reproducible Docker/vLLM deployment, tuning, and benchmarks for DeepSeek V4.1 Flash on a switchless three-node or four-node DGX Spark fab…☆110Updated this week
- GLM-5.3-Flash EXL3 (320B MoE) on 2x NVIDIA DGX Spark — production serving kit, 1M context, 97%+ multi-session prefix caching, DFlash2 spe…☆64Updated this week
- Minimal read-only OS image for GB10 (DGX Spark / ASUS GX10) boxes☆97Nov 1, 2026Updated last week
- EXLR8: a DGX Spark tuned quantization format☆14Oct 31, 2026Updated last week
- GLM-5.3-Flash (FP8) + DFlash2 speculative decoding on 4x NVIDIA DGX Spark / ASUS GX10: vLLM TP4, 256K context, switchless ConnectX-7 ring…☆30Oct 1, 2026Updated last month
- Local diagnostic CLI for NVIDIA DGX Spark (GB10). Detects power caps, UMA pressure, thermal risk, CUDA 13/SM_121 wheel mismatches, Docker…☆166Oct 22, 2026Updated 2 weeks ago
- DeepSeek-V4.1-Flash-1017 on NVIDIA DGX Sparks with TensorFold + EXL3: TP4 (4 Sparks, 93.6 tok/s, 1M context) and TP2 (2 Sparks, 73 tok/s)…☆161Oct 26, 2026Updated last week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- DeepSeek-V4.1-Flash on 2x NVIDIA DGX Spark with the TensorFold engine: 1.8-1.9x code, 2.5x multi-stream, 1.7-1.95x prefill vs the vLLM ki…☆133Updated this week
- ☆16Sep 25, 2026Updated last month
- Fish Audio Drama 3 text-to-speech on the TensorFold native CUDA engine for DGX Spark (GB10): recipe, engine patches, benchmarks. Built wi…☆148Updated this week
- Reproducible LLM inference on four NVIDIA DGX Spark (GB10) nodes wired as a direct switchless ConnectX ring — serving profiles, ring laun…☆21Oct 30, 2026Updated last week
- Serve LibertAIDAI/GLM-5.3-Flash-NVFP4 on 2x NVIDIA DGX Spark (GB10) with patched vLLM TP=2, 262k context, MTP-4.☆21Updated this week
- Free, keyless web_search and web_fetch for the DeepSeek Harness (dsh) — DuckDuckGo-backed, no signup. Unofficial community project.☆18Sep 28, 2026Updated last month
- Experimental runtime reclamation of GB10 display-reserved memory into ordinary Linux RAM, with guarded driver, local signing, and reboot …☆13Oct 23, 2026Updated 2 weeks ago
- Userland fan control for NVIDIA DGX Spark, with additive RPM floors, a temperature-based curve, Secure Boot signing, and DKMS support.☆47Oct 29, 2026Updated last week
- Fast & opinionated local AI routing: one MCP server that loads local image and video models on demand on your own GPU box (DGX Spark firs…☆98Nov 1, 2026Updated last week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- GLM-5.3 Flash EXL3 for 2-4x DGX Sparks☆749Updated this week
- GLM-5.3-Flash EXL3 on 2x DGX Spark with TensorFold☆528Updated this week
- vLLM inference solutions for NVIDIA GB10 (DGX Spark, sm121) — KIMI-K3 B12X_MLA + DSpark, GLM-5.2☆69Sep 30, 2026Updated last month
- Full GLM-5.3 on 4x DGX Spark with kindlingai gr8 (TP4): RigMark prose c1 29.0 -> 40.6 tok/s (+40 %), c4 63.7 -> 76.6☆12Oct 25, 2026Updated last week
- SparkHome: a tvOS-style home screen and voice assistant for the NVIDIA DGX Spark. Plugins for controllers, tiles and connectors; MCP for …☆39Updated this week
- First Int4-Int8Mix quantization of the full GLM-5.3 (743B), served on 4x NVIDIA DGX Spark (GB10) at TP4. Quantizer, verification gates, a…☆20Oct 6, 2026Updated last month
- A tiered-memory system design for workloads that don't fit in RAM: measure the working set, pin the hot tier, stream the cold tier from f…☆33Updated this week
- Recover usable memory on DGX Spark with a 64 KiB kernel: an opt-in NVIDIA UVM page-table packing patch, build tools, and measured validat…☆39Oct 16, 2026Updated 3 weeks ago
- qwen38-flash-next recipe for tp=2 GB10☆133Oct 29, 2026Updated last week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- GLM-5.3-Flash (NVFP4) at TP4 across 4x DGX Spark via a switchless RoCE ring + DFlash2 — reproducible recipe☆111Oct 25, 2026Updated last week
- Read-only dashboard and rack panel for NVIDIA DGX Spark-class nodes, other NVIDIA GPU Linux machines and Apple Silicon Macs running vLLM,…☆70Oct 23, 2026Updated 2 weeks ago
- GLM-5.3-Flash (Z.ai) NVFP4 (LibertAI) + NVFP4 KV, 1M context on 2x DGX Spark GB10 — vLLM TP2 recipe, walls ledger, benchmarks, needle to …☆29Aug 31, 2026Updated 2 months ago
- DeepSeek-V4.1-Flash on 3-4x NVIDIA DGX Sparks☆288Oct 17, 2026Updated 3 weeks ago
- Capping GPU clocks on NVIDIA GB10: -12C peak temp, -36% GPU power, ~1.6% throughput cost. Measurement harness, raw data, and the systemd …☆78Jul 31, 2026Updated 3 months ago
- A curated list of awesome local AI projects and repos☆52Updated this week
- Imagination Studio by keys+Wasserman powered by TensorFold: an AI film studio for Mac and NVIDIA DGX Spark. Plan a film like a crew (Slat…☆609Updated this week