GLM-5.3 (full) on 3-6 DGX Sparks (GB10): a from-scratch CUDA inference engine
☆37Oct 18, 2026Updated this week
Alternatives and similar repositories for gr8
Users that are interested in gr8 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Switchless RoCE collectives, NCCL profiles and fabric tooling for DGX Spark inference recipes☆37Updated this week
- GLM-5.3-Flash (NVFP4) at TP=4 across 4x ASUS GX10 / GB10 - vLLM + mentat instead of Ray, 524k context, DFlash2. Minimal working recipe.☆89Updated this week
- GLM-5.3-Flash EXL3 (320B MoE) on 2x NVIDIA DGX Spark — production serving kit, 1M context, 97%+ multi-session prefix caching, DFlash2 spe…☆62Oct 5, 2026Updated 2 weeks ago
- Minimal read-only OS image for GB10 (DGX Spark / ASUS GX10) boxes☆89Oct 4, 2026Updated 2 weeks ago
- GLM-5.3-Flash NVFP4 on 4x NVIDIA DGX Spark: vLLM TP4, DFlash2 adaptive draft, measured FP8 vs NVFP4 vs EXL3 vs SGLang☆37Sep 29, 2026Updated 2 weeks ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- CUDA Blackwell performance fork of antirez/ds4 (DeepSeek-V4-Flash): ~4x prefill, ~1.5x decode, continuous batching, weight server, DSpark☆77Sep 4, 2026Updated last month
- keys-Wasserman Slate AI Studio powered by TensorFold: an AI film studio for Mac and NVIDIA DGX Spark. Plan a film like a crew (Slate work…☆142Updated this week
- An environment where open models work as agents: a first-level harness with routing, skills, memory and sandboxed tools, on an engine tha…☆54Updated this week
- Read-only dashboard and rack panel for NVIDIA DGX Spark-class nodes, other NVIDIA GPU Linux machines and Apple Silicon Macs running vLLM,…☆71Oct 10, 2026Updated last week
- English guide + one-command patcher for the vLLM spin-wait bug that overheats NVIDIA DGX Spark / GB10. Credit: nacyot. CPU cores spin at …☆24Aug 17, 2026Updated 2 months ago
- vLLM inference solutions for NVIDIA GB10 (DGX Spark, sm121) — KIMI-K3 B12X_MLA + DSpark, GLM-5.2☆67Sep 30, 2026Updated 2 weeks ago
- qwen38-flash-next recipe for tp=2 GB10☆127Oct 6, 2026Updated last week
- A tiered-memory system design for workloads that don't fit in RAM: measure the working set, pin the hot tier, stream the cold tier from f…☆28Updated this week
- DeepSeek-V4.1-Flash on two NVIDIA DGX Sparks: EXL3 weights from the official checkpoint, upstream vLLM with our patches and decode kernel…☆38Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- GLM-5.3-Flash (NVFP4) at TP4 across 4x DGX Spark via a switchless RoCE ring + DFlash2 — reproducible recipe☆108Updated this week
- A curated list of awesome local AI projects and repos☆46Updated this week
- Fast, capable GLM-5.3-Flash FP4-Local on two DGX Sparks: opinionated Atlas serving and reproducible inference research.☆60Updated this week
- Give DeepSeek V4 Flash eyes. OpenAI-compatible shim + tiny local VLM. Point any harness at one URL and your text-only model accepts image…☆30Aug 9, 2026Updated 2 months ago
- GLM-5.3 Flash EXL3 for 2-4x DGX Sparks☆736Updated this week
- One script to install, run, update, and maintain ComfyUI on the NVIDIA DGX Spark (GB10 Grace Blackwell).☆76Oct 10, 2026Updated last week
- Fish Audio Drama 3 text-to-speech on the TensorFold native CUDA engine for DGX Spark (GB10): recipe, engine patches, benchmarks. Built wi…☆29Updated this week
- An GB10-optimized inference engine☆108Updated this week
- keys-DGX-Sparkticus Utimate Power Pack Unleashed (Dual DGX-Sparks Needed)☆43Aug 23, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- GLM-5.3-Flash (320B MoE) at TP4 across four DGX Sparks, same day as the model drop: 36 tok/s, 1.26M-token FP8 KV pool, 262K context, MTP …☆57Oct 10, 2026Updated last week
- DeepSeek-V4.1-Flash on 3-4x NVIDIA DGX Sparks☆247Updated this week
- Atlas Inference is a dependency free lightweight inference engine meant to run LLMs on YOUR compute seamlessly. Supports GB10 and Strix H…☆34Updated this week
- Metal Cuda Direct Memory Access☆197Updated this week
- ☆41Aug 16, 2026Updated 2 months ago
- Capping GPU clocks on NVIDIA GB10: -12C peak temp, -36% GPU power, ~1.6% throughput cost. Measurement harness, raw data, and the systemd …☆77Jul 31, 2026Updated 2 months ago
- Qwen3.8-Flash-Next-NVFP4-vLLM-Dual-DGX-Spark☆411Sep 29, 2026Updated 2 weeks ago
- Sglang LLM Inference: RTX Pro 6000 vs DGX Spark☆22Oct 18, 2025Updated last year
- DeepSeek V4 Flash DSpark 1M NVFP4 KV recipe for 2x DGX Spark☆494Sep 10, 2026Updated last month
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- GLM-5.2-Int4-Int8 on 8x GB10 cluster☆39Jul 30, 2026Updated 2 months ago
- Plug-and-play, dependency-free web command center for DGX Spark fleets (and any GPU boxes): live per-node GPU/CPU/mem/temps/power, option…☆48Updated this week
- MiniMax-H3 on single DGX Spark: keys Sol-Engine ports + Heretic TE + Spectrum/Sage speed + 0.5MP upscaler finish. Formal bench included.☆49Aug 23, 2026Updated last month
- Live dashboard: fire N parallel streaming coding-agent runs at any OpenAI-compatible endpoint — per-run TTFT/tok-s/E2E, real kill switch,…☆27Jul 23, 2026Updated 2 months ago
- Serve typed-decision (System 1) models — Laya or your own — on NVIDIA GPUs or Apple Silicon, with a Jev-compatible API and coding-agent i…☆35Sep 24, 2026Updated 3 weeks ago
- Two-node DGX Spark/ASUS GX10 DeepSeek V4 Flash DSpark NVFP4 port for vLLM 0.25, with live dashboard and reproducible deployment.☆81Sep 13, 2026Updated last month
- Serve the official Ling-3.0-flash INT4 on one NVIDIA DGX Spark, 38.7 tok/s, faster than the community GGUF. Recipe, watchdog, benchmarks.☆26Aug 29, 2026Updated last month