English guide + one-command patcher for the vLLM spin-wait bug that overheats NVIDIA DGX Spark / GB10. Credit: nacyot. CPU cores spin at full clock waiting on shm_broadcast; 1s -> 2ms drops SoC up to 24C with no throughput cost.
☆24Aug 17, 2026Updated 2 months ago
Alternatives and similar repositories for vllm-gb10-spin-wait-fix
Users that are interested in vllm-gb10-spin-wait-fix are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- CUDA Blackwell performance fork of antirez/ds4 (DeepSeek-V4-Flash): ~4x prefill, ~1.5x decode, continuous batching, weight server, DSpark☆77Sep 4, 2026Updated last month
- Autonomous self-improving 4x DGX Spark (GB10) MoA stack + LoRA loop (DSV4F router, Qwen3.6/Omni/TwoTower/Gemma). Hermes MoA routing, ~90%…☆24Aug 17, 2026Updated 2 months ago
- 1.0 Beta · oMLX 0.6.3rc2 Dual-ANE+CPU · Qwen3.8-27B abliterated oQ4e · Mac Studio M3 Ultra☆45Aug 23, 2026Updated last month
- Minimal read-only OS image for GB10 (DGX Spark / ASUS GX10) boxes☆89Oct 4, 2026Updated 2 weeks ago
- A tiered-memory system design for workloads that don't fit in RAM: measure the working set, pin the hot tier, stream the cold tier from f…☆28Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Switchless RoCE collectives, NCCL profiles and fabric tooling for DGX Spark inference recipes☆37Updated this week
- DeepSeek-V4-Flash-DSpark optimized vLLM 0.26.0 SM121 dual-GB10 evidence (NVFP4 KV, B12X, DSpark K6)☆31Aug 3, 2026Updated 2 months ago
- Grafana dashboard for NVIDIA DGX Spark clusters running vLLM: throughput, contention, and GB10 GPU hardware telemetry (NVIDIA-themed, 55 …☆41Aug 18, 2026Updated 2 months ago
- GLM-5.3 (full) on 3-6 DGX Sparks (GB10): a from-scratch CUDA inference engine☆37Updated this week
- qwen38-flash-next recipe for tp=2 GB10☆127Oct 6, 2026Updated last week
- P2P support for nvidia consumer cards☆23Sep 5, 2026Updated last month
- Give DeepSeek V4 Flash eyes. OpenAI-compatible shim + tiny local VLM. Point any harness at one URL and your text-only model accepts image…☆30Aug 9, 2026Updated 2 months ago
- keys-Wasserman Slate AI Studio powered by TensorFold: an AI film studio for Mac and NVIDIA DGX Spark. Plan a film like a crew (Slate work…☆142Updated this week
- GLM-5.3-Flash EXL3 (320B MoE) on 2x NVIDIA DGX Spark — production serving kit, 1M context, 97%+ multi-session prefix caching, DFlash2 spe…☆62Oct 5, 2026Updated 2 weeks ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Heterogeneous prefill/decode for DeepSeek-V4-Flash: CUDA prefill (DGX Spark, vLLM) -> Metal decode (Mac Studio, oMLX) over plain 10GbE☆151Updated this week
- Run DeepSeek-V4-Flash at full 1M context AND two MiniMax H3 video instances on the same two DGX Sparks. Benchmarked C1-C6.☆35Aug 7, 2026Updated 2 months ago
- Atlas Inference is a dependency free lightweight inference engine meant to run LLMs on YOUR compute seamlessly. Supports GB10 and Strix H…☆34Updated this week
- 3D models for DGX cases☆55Aug 14, 2026Updated 2 months ago
- A curated list of awesome local AI projects and repos☆46Updated this week
- Pinned one-DGX-Spark Docker recipe for DeepSeek V4 Flash with EXL3, SparkInfer, and 262K NVFP4 MLA KV cache☆166Sep 3, 2026Updated last month
- Capping GPU clocks on NVIDIA GB10: -12C peak temp, -36% GPU power, ~1.6% throughput cost. Measurement harness, raw data, and the systemd …☆77Jul 31, 2026Updated 2 months ago
- Local image generation and editing for NVIDIA DGX Spark, powered by Qwen-Image-2.1 and Gradio.☆31Sep 21, 2026Updated 3 weeks ago
- Local-first AI workbench for OCR, transcription, translation, image generation, mind maps and composable workflows. Built for DGX Spark.☆68Sep 2, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- GLM-5.3-Flash (abliterated EXL3) on 2x NVIDIA DGX Spark with the TensorFold engine: 1.8x faster decode than vLLM, 4x256k concurrent threa…☆115Oct 5, 2026Updated last week
- Custom inference recipes for NVIDIA DGX Spark — Qwen 122B DFlash hybrid☆81Updated this week
- Measured SM121 compatibility recipe for MiniMax H3 FL2VA on one NVIDIA DGX Spark with vLLM-Omni and online FP8.☆61Aug 4, 2026Updated 2 months ago
- Working recipe to serve DeepSeek-V4-Flash across two NVIDIA DGX Spark (GB10) nodes with vLLM (TP=2, FP8 KV, MTP) over a RoCE/RDMA link — …☆83Jul 13, 2026Updated 3 months ago
- Self-improving Codex loop: DeepSeek runs the task, Luna grades it, Sol rewrites the prompt until it is done☆47Sep 16, 2026Updated last month
- An GB10-optimized inference engine☆108Updated this week
- Community registry of LLM serving-path traps that produce confidently wrong measurements: templates, tool parsers, reasoning fields, quan…☆135Updated this week
- Optimized inference for the DGX Spark and spark clusters☆123Updated this week
- vLLM inference solutions for NVIDIA GB10 (DGX Spark, sm121) — KIMI-K3 B12X_MLA + DSpark, GLM-5.2☆67Sep 30, 2026Updated 2 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- GLM-5.3-Flash (NVFP4) at TP=4 across 4x ASUS GX10 / GB10 - vLLM + mentat instead of Ray, 524k context, DFlash2. Minimal working recipe.☆89Updated this week
- Local diagnostic CLI for NVIDIA DGX Spark (GB10). Detects power caps, UMA pressure, thermal risk, CUDA 13/SM_121 wheel mismatches, Docker…☆163Oct 4, 2026Updated 2 weeks ago
- 🚀 A self-hosted AI PR reviewer.☆62Updated this week
- GLM-5.3-Flash EXL3 on 2x DGX Spark with TensorFold☆457Updated this week
- 蒸留蔵 — distilled long-term memory for agents: recall by meaning, writing gated by evidence, one kura per agent mode. Ships as a DeepSeek H…☆53Sep 30, 2026Updated 2 weeks ago
- Read-only dashboard and rack panel for NVIDIA DGX Spark-class nodes, other NVIDIA GPU Linux machines and Apple Silicon Macs running vLLM,…☆71Oct 10, 2026Updated last week
- A Prometheus metrics exporter for NVIDIA DGX Spark clusters.☆25Feb 16, 2026Updated 8 months ago