Archived: b12x development has moved to FlashInfer. See README for migration and PR-porting guidance.
☆269Oct 6, 2026Updated last month
Alternatives and similar repositories for b12x
Users that are interested in b12x are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A high-throughput and memory-efficient inference and serving engine for LLMs☆47Oct 27, 2026Updated 3 weeks ago
- Docker images for LLM inference (SGLang + vLLM) on NVIDIA Blackwell GPUs (SM120, CUDA 13.2)☆100Oct 20, 2026Updated last month
- RTX 6000 Pro Wiki — Running Large LLMs (Qwen3.5-397B, Kimi-K2.5, GLM-5) on PCIe GPUs without NVLink☆1,213Updated this week
- LLM inference decode throughput benchmark with Rich TUI dashboard. Measures token generation speed across concurrency levels and context …☆131Nov 4, 2026Updated 2 weeks ago
- AEON vLLM Ultimate — vLLM 0.27.1 built from source for DGX Spark / Blackwell (sm_121a/GB10). DSpark quantized Markov heads, DFlash SWA on…☆149Nov 13, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆17Jun 17, 2026Updated 5 months ago
- ☆820Updated this week
- A very-low-resource API-compatible replacement for Ray☆13Nov 1, 2026Updated 2 weeks ago
- ☆17Aug 13, 2026Updated 3 months ago
- DeepSeek-V4-Flash-0731 tuned on 4x DGX Spark (GB10) at TP=4 — 123.13 tok/s decode. Every variable measured one at a time, with the values…☆13Aug 11, 2026Updated 3 months ago
- Working recipe: MiniMax-M3 NVFP4 at tensor-parallel 3 across 3x DGX Spark (GB10/sm_121) with clean tool-calling. Includes the head-node O…☆16Jul 13, 2026Updated 4 months ago
- Wrap commands that might cause out-of-memory errors, and stop them before they freeze your machine☆15Updated this week
- FlashQLA TileLang GDN kernels ported to NVIDIA Blackwell consumer (GB10 / DGX Spark)☆18Jun 5, 2026Updated 5 months ago
- GLM-5.3-Flash (NVFP4) at TP=4 across 4x ASUS GX10 / GB10 - vLLM + mentat instead of Ray, 524k context, DFlash2. Minimal working recipe.☆96Nov 6, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- MiniMax-H3 on single DGX Spark: keys Sol-Engine ports + Heretic TE + Spectrum/Sage speed + 0.5MP upscaler finish. Formal bench included.☆51Aug 23, 2026Updated 2 months ago
- Agent-friendly GPU profile-query CLI☆131Oct 4, 2026Updated last month
- Minimal read-only OS image for GB10 (DGX Spark / ASUS GX10) boxes☆99Nov 12, 2026Updated last week
- Educational reference: NVIDIA Blackwell SM100 vs SM120, NVFP4, tcgen05, MoE inference on consumer Blackwell☆29Sep 3, 2026Updated 2 months ago
- Low-latency collective transport and distributed LLM serving stack for switchless GB10 clusters.☆106Nov 2, 2026Updated 2 weeks ago
- antirez/ds4-style hybrid quant DeepSeek V4 Flash on a single DGX Spark via vLLM☆18May 11, 2026Updated 6 months ago
- GLM-5.3-Flash NVFP4 on two or four DGX Sparks cabled as a ring, with no switch: the RiNGSiDE serving recipe☆31Sep 27, 2026Updated last month
- Docker configuration for running VLLM on dual DGX Sparks☆2,503Updated this week
- Native DeepSeek V4.1 Flash inference across one RTX PRO 6000 and four DGX Spark expert workers☆41Sep 25, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- GLM-5.2-Int4-Int8 on 8x GB10 cluster☆39Jul 30, 2026Updated 3 months ago
- MiniMax-M3 (428B, no pruning) at 36 tok/s on 2× NVIDIA DGX Spark — W4A16 GPTQ + NVFP4 KV + EAGLE-3 speculative decoding on vLLM. Three se…☆45Jul 13, 2026Updated 4 months ago
- Tool-calling quality benchmark for LLM serving stacks. 80+ deterministic scenarios testing multi-turn orchestration, safety boundaries, a…☆434Updated this week
- Pure Rust Inference Engine☆737Updated this week
- GLM-5.2 Quantrio INT4/INT8 Mixed Abliterated — SPEED=1 C1≈30 tok/s @ 128k on 4x DGX Spark. Step-by-step recipe, image bake, results.☆13Jul 18, 2026Updated 4 months ago
- SGLang for GLM-5.3-Flash on two or four RTX PRO 6000 Blackwell GPUs (SM120), with TP2 W4A16 and TP4 NVIDIA NVFP4 profiles.☆47Oct 11, 2026Updated last month
- Deploy DeepSeek V4 Flash (MoE reasoning model) on dual DGX Spark nodes with 1M token context, InfiniBand, and FP8 KV-cache☆108Aug 20, 2026Updated 2 months ago
- GLM-5.3-Flash (NVFP4) at TP4 across 4x DGX Spark via a switchless RoCE ring + DFlash2 — reproducible recipe☆112Oct 25, 2026Updated 3 weeks ago
- GLM-5.2 (744B/40B MoE) on a 4× DGX Spark / GB10 (sm_121) cluster: portable Triton sparse-MLA kernels, a data-free expert prune, MTP draft…☆37Aug 20, 2026Updated 2 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Mixed-precision quantization for LLMs. Every layer refracts into a different format based on its sensitivity. Native compressed-tensors e…☆105Updated this week
- Recipe: GLM-5.2 (unpruned QuantTrio Int4-Int8Mix) at 200K ctx with MTP spec decode on a 4x NVIDIA DGX Spark (GB10) cluster☆77Jul 25, 2026Updated 3 months ago
- ☆37Apr 26, 2026Updated 6 months ago
- Humming is a high-performance, lightweight, and highly flexible JIT (Just-In-Time) compiled GEMM kernel library specifically designed for…☆369Updated this week
- Grafana dashboard for NVIDIA DGX Spark clusters running vLLM: throughput, contention, and GB10 GPU hardware telemetry (NVIDIA-themed, 55 …☆45Aug 18, 2026Updated 3 months ago
- Local model hosting with 2x DGX Sparks☆12Aug 29, 2026Updated 2 months ago
- Frontier MoE models on RTX PRO 6000 / RTX 5090 (sm_120): DeepSeek-V4.1-Flash on 4x RTX PRO 6000, as a GPU+CPU hybrid on 4x RTX 5090, and …☆579Updated this week
Are these results useful?