vLLM inference solutions for NVIDIA GB10 (DGX Spark, sm121) — KIMI-K3 B12X_MLA + DSpark, GLM-5.2
☆67Sep 30, 2026Updated 2 weeks ago
Alternatives and similar repositories for gb10-vllm
Users that are interested in gb10-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Serve EXL3 (ExLlamaV3 trellis) quantized models on vLLM fork runtimes — any architecture, mixed per-layer bitrates, composable with sourc…☆26Updated this week
- A curated list of tools, guides, playbooks, and resources for the NVIDIA DGX Spark (GB10 Grace Blackwell personal AI supercomputer).☆86Oct 8, 2026Updated last week
- Community registry of LLM serving-path traps that produce confidently wrong measurements: templates, tool parsers, reasoning fields, quan…☆135Updated this week
- GLM-5.3-Flash (NVFP4) at TP4 across 4x DGX Spark via a switchless RoCE ring + DFlash2 — reproducible recipe☆106Updated this week
- Pinned one-DGX-Spark Docker recipe for DeepSeek V4 Flash with EXL3, SparkInfer, and 262K NVFP4 MLA KV cache☆166Sep 3, 2026Updated last month
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Capping GPU clocks on NVIDIA GB10: -12C peak temp, -36% GPU power, ~1.6% throughput cost. Measurement harness, raw data, and the systemd …☆77Jul 31, 2026Updated 2 months ago
- CUDA Blackwell performance fork of antirez/ds4 (DeepSeek-V4-Flash): ~4x prefill, ~1.5x decode, continuous batching, weight server, DSpark☆77Sep 4, 2026Updated last month
- Low-latency collective transport and distributed LLM serving stack for switchless GB10 clusters.☆94Updated this week
- GLM-5.2 NVFP4+AQLM on 3× DGX Spark — 380k context MTP serve stack☆72Aug 2, 2026Updated 2 months ago
- Metal Cuda Direct Memory Access☆196Updated this week
- Minimal read-only OS image for GB10 (DGX Spark / ASUS GX10) boxes☆90Oct 4, 2026Updated last week
- Qwen3.8 27B on SGLang for DGX Spark☆474Sep 12, 2026Updated last month
- GLM-5.3 Flash EXL3 for 2-4x DGX Sparks☆735Updated this week
- sparkDash ⚡ — Multi-DGX Spark Monitoring Dashboard☆703Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆41Aug 16, 2026Updated 2 months ago
- Best-of-N coding agents with LLM-as-a-Verifier selection for Oh My Pi: isolated git worktrees, verifier-ranked trajectories, winner-only …☆73Oct 1, 2026Updated 2 weeks ago
- LLM Inference Engine for Metal and CUDA.☆1,359Updated this week
- Heterogeneous prefill/decode for DeepSeek-V4-Flash: CUDA prefill (DGX Spark, vLLM) -> Metal decode (Mac Studio, oMLX) over plain 10GbE☆151Updated this week
- Run agents in isolated cells that borrow verified tools instead of rebuilding Linux environments.☆62Updated this week
- GLM-5.3-Flash EXL3 2.05 on one DGX Spark — TP1 vLLM, DFlash2 K5, concurrency, 262K context, and published fidelity measurements☆53Sep 22, 2026Updated 3 weeks ago
- Optimized inference for the DGX Spark and spark clusters☆120Updated this week
- Scheduled restic backups for Omarchy, with a snapshot browser in the bar☆128Updated this week
- DeepSeek-v4-Flash 0731 recipe for 2x DGX Sparks☆1,463Oct 4, 2026Updated last week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- DeepSeek V4.1 Flash on 4x RTX PRO 6000 Blackwell: native weights, DSpark, vision, NVMe or locked RAM Engram offload.☆67Updated this week
- GLM-5.2-NVFP4-REAP-469B serving on SM120 (4× RTX PRO 6000 Blackwell) — one-command vLLM launch recipe, 250K context, DeepSeek Sparse Atte…☆155Jun 19, 2026Updated 3 months ago
- My reasearch of losslessly compressing LLM weights.☆65Jul 23, 2026Updated 2 months ago
- A minimal autonomous code-agent CLI built with Qwen Code☆834Aug 12, 2026Updated 2 months ago
- Serve GLM-5.2 469B (REAP-pruned, NVFP4) across 3× NVIDIA DGX Spark with vLLM pipeline parallelism — 256K context, production-ready config…☆34Jul 12, 2026Updated 3 months ago
- ☆37Apr 26, 2026Updated 5 months ago
- Porting MMU Linux to ESP32-S31☆208Oct 8, 2026Updated last week
- Interactive canvas for taking an LLM apart tensor by tensor: measured INT8/INT4/FP8 error, distributions, spectra and outlier channels fo…☆75Sep 2, 2026Updated last month
- Conformance and capability test suite for LLM inference engines — surface coverage, spec conformance, model capability, and an MTP/perfor…☆49Oct 5, 2026Updated last week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Command line tool to kickstart installing packages after a fresh install. Support Linux distros / OSX☆11Feb 5, 2023Updated 3 years ago
- Dart boltz client☆11Sep 9, 2026Updated last month
- RISE: Red-teaming via Iterative Strategy Evolution (NeurIPS 2026)☆125Updated this week
- AGI runtime for bounded recursive self-awareness. Attempting machine consciousness at the Gödel–Turing–Hofstadter Nexus.☆17Oct 5, 2026Updated last week
- Find your memory Timings of a Ryzen Zen2+ cpu under linux!☆13Sep 26, 2026Updated 3 weeks ago
- A Hermes Agent plugin that makes your bot feel like a person in the chat instead of a bot. It plugs into the Humalike APIs so the agent k…☆211Sep 22, 2026Updated 3 weeks ago
- ☆515Oct 2, 2026Updated 2 weeks ago