An GB10-optimized inference engine
☆108Oct 12, 2026Updated this week
Alternatives and similar repositories for veloGB10
Users that are interested in veloGB10 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Optimized inference for the DGX Spark and spark clusters☆123Updated this week
- Qwen3.8-Flash-Next (NVFP4) on DGX Spark in vLLM: one Spark 43.9 tok/s with our disk-backed n-gram table patch, staged gather and reduced-…☆128Sep 7, 2026Updated last month
- GLM-5.3-Flash EXL3 2.05 on one DGX Spark — TP1 vLLM, DFlash2 K5, concurrency, 262K context, and published fidelity measurements☆53Sep 22, 2026Updated 3 weeks ago
- Serving 4-bit Qwen3.8-27B on a single DGX Spark (GB10): 75 tok/s single-stream, 246 tok/s aggregate at 8-way concurrency. NVFP4 vs MixedI…☆51Sep 29, 2026Updated 2 weeks ago
- Terminal system monitor (TUI) that builds its layout from the hardware it actually finds — hybrid CPU clusters, GPUs, RDMA/RoCE NICs, PCI…☆17Aug 1, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- recipe for running Qwen3.8-Flash-Next on a single DGX Spark (fork)☆45Oct 5, 2026Updated last week
- GLM-5.3 (full) on 3-6 DGX Sparks (GB10): a from-scratch CUDA inference engine☆37Updated this week
- CUDA Blackwell performance fork of antirez/ds4 (DeepSeek-V4-Flash): ~4x prefill, ~1.5x decode, continuous batching, weight server, DSpark☆77Sep 4, 2026Updated last month
- Metal Cuda Direct Memory Access☆197Updated this week
- Minimal read-only OS image for GB10 (DGX Spark / ASUS GX10) boxes☆89Oct 4, 2026Updated 2 weeks ago
- vLLM inference solutions for NVIDIA GB10 (DGX Spark, sm121) — KIMI-K3 B12X_MLA + DSpark, GLM-5.2☆67Sep 30, 2026Updated 2 weeks ago
- English guide + one-command patcher for the vLLM spin-wait bug that overheats NVIDIA DGX Spark / GB10. Credit: nacyot. CPU cores spin at …☆24Aug 17, 2026Updated 2 months ago
- Qwen3.8 Flash at 74 tok/s on a single DGX Spark / GB10. vLLM + MTP recipe, 212 tok/s at 8 streams.☆74Sep 29, 2026Updated 2 weeks ago
- GLM-5.3-Flash NVFP4 on 4x NVIDIA DGX Spark: vLLM TP4, DFlash2 adaptive draft, measured FP8 vs NVFP4 vs EXL3 vs SGLang☆37Sep 29, 2026Updated 2 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Pinned, checksum-verified GLM-5.3-Flash EXL3 K2 recipe for one NVIDIA GB10.☆38Updated this week
- Measured SM121 compatibility recipe for MiniMax H3 FL2VA on one NVIDIA DGX Spark with vLLM-Omni and online FP8.☆61Aug 4, 2026Updated 2 months ago
- Small System One decision models (17M–400M) for Yes/No, Choice, Score, and reranking. Training toolkit, Python inference, and ONNX suppor…☆37Updated this week
- Atlas Inference is a dependency free lightweight inference engine meant to run LLMs on YOUR compute seamlessly. Supports GB10 and Strix H…☆34Updated this week
- keys-Wasserman Slate AI Studio powered by TensorFold: an AI film studio for Mac and NVIDIA DGX Spark. Plan a film like a crew (Slate work…☆142Updated this week
- Entrpi/ds4, a Blackwell CUDA perf fork of antirez/ds4 on NVIDIA DGX Spark: one-command install, ~3x upstream prefill, ~1.5x decode, DSpar…☆410Aug 27, 2026Updated last month
- Community registry of LLM serving-path traps that produce confidently wrong measurements: templates, tool parsers, reasoning fields, quan…☆135Updated this week
- Qwen3.8 Flash Next on one DGX Spark (TensorFold)☆270Updated this week
- Fastest MoE/LLM inference runtime for consumer and edge Blackwell GPUs. SN74 on Gittensor.☆89Oct 11, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Local-first AI workbench for OCR, transcription, translation, image generation, mind maps and composable workflows. Built for DGX Spark.☆68Sep 2, 2026Updated last month
- Codeberg fork of StillDeadcode / vllm-radiance which is a custom vllm tuned for R9700 GPU's☆125Updated this week
- 8s of H3 video in 2m54s warm delivery on two DGX Sparks. Scene-specific LTX refinement, original-voice restoration, measured sync, clips …☆22Sep 12, 2026Updated last month
- a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features (GGUF, RadixAttention, Cache-…☆452Updated this week
- Quasar is an inference engine for Qwen3.6-27B-MTP / Qwen3.8-27B on consumer NVIDIA cards as well as Apple Silicon, in the spirit of antir…☆46Oct 11, 2026Updated last week
- Test to see if a DGX Spark (or similar GB10 device) is throttling due to possible Power Delivery issues☆32Sep 28, 2026Updated 2 weeks ago
- Qwen3.8-Flash-Next on ONE DGX Spark (TP=1)☆610Oct 4, 2026Updated 2 weeks ago
- Run Qwen3.8-Flash-Next (180B) on a single DGX Spark by keeping its 51B n-gram embedding table on NVMe☆125Aug 30, 2026Updated last month
- A curated list of awesome local AI projects and repos☆46Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- qwen38-flash-next recipe for tp=2 GB10☆127Oct 6, 2026Updated last week
- Two-node DGX Spark/ASUS GX10 DeepSeek V4 Flash DSpark NVFP4 port for vLLM 0.25, with live dashboard and reproducible deployment.☆81Sep 13, 2026Updated last month
- Verified Qwen3.8 Flash-Next GGUF recipe for one NVIDIA DGX Spark or ASUS Ascent GX10☆60Updated this week
- Fast, capable GLM-5.3-Flash FP4-Local on two DGX Sparks: opinionated Atlas serving and reproducible inference research.☆60Updated this week
- qwen38-flash-next recipe for solo GB10☆148Oct 5, 2026Updated last week
- STEP AP242 Native-ish BREP Geometric Modeling Kernel☆56Updated this week
- Apple Silicon GPU DVFS reverse engineering: voltage corners, CLPC frequency control, Metal benchmarks☆63Aug 24, 2026Updated last month