Serve the home! Inference stack for your Nvidia DGX / RTX Spark (128GB ram) aka the Grace Blackwell AI supercomputer on your desk. Mostly vLLM based for now and single-spark. For the not-so-rich people. Updated once a month. Hobby project
☆52Oct 11, 2026Updated last month
Alternatives and similar repositories for dgx-spark-inference-stack
Users that are interested in dgx-spark-inference-stack are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Browser-based model and inference management for NVIDIA DGX Spark - inventory local and Hugging Face models, manage Ollama and LiteLLM, g…☆57Oct 18, 2026Updated 3 weeks ago
- SparkPilot puts your NVIDIA DGX Spark to work, free forever.☆16Sep 11, 2026Updated 2 months ago
- Docker configuration for running VLLM on dual DGX Sparks☆2,495Nov 7, 2026Updated last week
- Bleeding-edge ComfyUI for NVIDIA DGX Spark (GB10/Blackwell/sm_121a). CUDA 13 + SageAttention v3 (sm_121a) + NVFP4 + 14 custom-node packs …☆90Updated this week
- A dedicated effort to make an optimized, bleeding edge vLLM image using Docker to support DGX comprehensively☆128Feb 22, 2026Updated 8 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- MiniMax M2 inference server for NVIDIA DGX Spark☆17Jan 24, 2026Updated 9 months ago
- Cursor free trial reset tool — bypass request limits, restore Pro access & unlock unlimited AI. Free & open source.☆41Sep 4, 2026Updated 2 months ago
- A dashboard for a home cluster of NVIDIA GB10 (DGX Spark / ASUS GX10) inference servers: GPU and system health, plus live per-model metri…☆16Updated this week
- Some benchmark results of small models and quants that fit on DGX Spark☆51Aug 23, 2026Updated 2 months ago
- Deploy concurrent Hermes Agent workers on unified-memory GPUs (GB10, DGX Spark) for maximum total tok/s. Profile-isolated, kanban-coordin…☆83Jul 18, 2026Updated 3 months ago
- Real-time hardware and LLM inference monitoring — GPU, CPU, memory, and vLLM metrics streamed to a dashboard.☆143Oct 17, 2026Updated 3 weeks ago
- sparkrun - launch, manage, and stop LLM inference workloads on NVIDIA DGX Spark systems. Live support: https://discord.com/invite/GH5kRg…☆565Updated this week
- One-command vLLM installation for NVIDIA DGX Spark with Blackwell GB10 GPUs (sm_121 architecture)☆111Oct 28, 2025Updated last year
- A script to deploy comfyui and a manager to a Mac in a few seconds.☆14Nov 30, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- vLLM Tune consolidates MoE and FP8 dense GEMM kernel tuning into a single command☆32May 24, 2026Updated 5 months ago
- vLLM + Qwen3.5-122B-A10B-NVFP4 on NVIDIA DGX Spark (GB10/SM121) — single-GPU NVFP4 W4A4 with MTP speculative decoding, self-contained Doc…☆41Mar 12, 2026Updated 8 months ago
- Dual-engine (llama.cpp + vLLM) LLM benchmarking pipeline for GGUF & safetensors on NVIDIA GPUs — speed, quality, live dashboard, publisha…☆48Updated this week
- Pragmatic Network Security for Cloud and Hybrid Networks☆10Nov 24, 2015Updated 10 years ago
- LLM fine-tuning with LoRA + NVFP4/MXFP8 on NVIDIA DGX Spark (Blackwell GB10)☆22Dec 22, 2025Updated 10 months ago
- A curated list of tools, guides, playbooks, and resources for the NVIDIA DGX Spark (GB10 Grace Blackwell personal AI supercomputer).☆100Nov 4, 2026Updated last week
- A DHCPv6, TFTP, and HTTP service which assigns IPv6 addresses strictly by MAC address, and coordinates network boot.☆12Updated this week
- ☆14Nov 17, 2025Updated 11 months ago
- MiMo-V2.5 NVFP4 4-bit weights + NVFP4 4-bit KV cache + DFlash speculative decoding on 2× NVIDIA DGX Spark — 1M context, 3.4M-token KV poo…☆18Jul 13, 2026Updated 4 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Open quantization tooling for TurboQuant-style low-bit LLM releases, stock GGUF deployment, and Apple Silicon runtime experiments.☆10May 5, 2026Updated 6 months ago
- Qwen3.5-122B-A10B on DGX Spark: 28.3 → 51 tok/s (+80%)☆316Aug 23, 2026Updated 2 months ago
- Pure Rust Inference Engine☆717Updated this week
- Entrpi/ds4, a Blackwell CUDA perf fork of antirez/ds4 on NVIDIA DGX Spark: one-command install, ~3x upstream prefill, ~1.5x decode, DSpar…☆414Aug 27, 2026Updated 2 months ago
- Qwen-Image 2.1 on TensorFold's NVFP4 kernels: a drop-in ComfyUI loader, 4x faster than the GGUF path on one RTX 5070 Ti (native Windows).…☆11Oct 3, 2026Updated last month
- W4A4 full（VLLM_MOE_W4A4=2）+ （VLLM_B12X_SHARED_WRAPPER=1）+ FlashInfer 0.6.16 + threshold 4096 + util 0.78 + DSpark MTP n7 + CUMEM=0☆16Aug 26, 2026Updated 2 months ago
- Recover usable memory on DGX Spark with a 64 KiB kernel: an opt-in NVIDIA UVM page-table packing patch, build tools, and measured validat…☆39Oct 16, 2026Updated 3 weeks ago
- mlx-lm server wrapper for agentic harness☆21Jan 26, 2026Updated 9 months ago
- Manage your self-defined cheat sheets & knowledge base in Alfred☆14Dec 25, 2023Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Running MiniMax-M2.5 on a Nvidia DGX Spark with OpenCode on the remote machine☆12Feb 19, 2026Updated 8 months ago
- 手把手训练一个属于自己的 Jev：训练代码 + 7500 条合成数据☆12Sep 27, 2026Updated last month
- MCP-first local context retrieval for AI coding tools — BM25 over markdown + SQLite learned memory. Works with Claude Code, Codex, Gemini…☆14May 5, 2026Updated 6 months ago
- ☆17Nov 7, 2026Updated last week
- ComfyUI + SageAttention for NVIDIA DGX Spark (Blackwell GB10, ARM64, sm_121)☆16May 22, 2026Updated 5 months ago
- Skills to implement agentic commerce☆16Feb 4, 2026Updated 9 months ago
- Serve GLM-5.2 469B (REAP-pruned, NVFP4) across 3× NVIDIA DGX Spark with vLLM pipeline parallelism — 256K context, production-ready config…☆34Jul 12, 2026Updated 4 months ago
Are these results useful?