Docker images for LLM inference (SGLang + vLLM) on NVIDIA Blackwell GPUs (SM120, CUDA 13.2)
☆100Oct 20, 2026Updated 3 weeks ago
Alternatives and similar repositories for blackwell-llm-docker
Users that are interested in blackwell-llm-docker are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM inference decode throughput benchmark with Rich TUI dashboard. Measures token generation speed across concurrency levels and context …☆129Nov 4, 2026Updated last week
- ☆17Jun 17, 2026Updated 4 months ago
- Archived: b12x development has moved to FlashInfer. See README for migration and PR-porting guidance.☆270Oct 6, 2026Updated last month
- A high-throughput and memory-efficient inference and serving engine for LLMs☆47Oct 27, 2026Updated 2 weeks ago
- Reproducible SGLang image for DeepSeek-V4-Flash-0731 on SM120☆38Aug 25, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆24Oct 13, 2026Updated 3 weeks ago
- ☆800Updated this week
- Frontier MoE models on RTX PRO 6000 / RTX 5090 (sm_120): DeepSeek-V4.1-Flash on 4x RTX PRO 6000, as a GPU+CPU hybrid on 4x RTX 5090, and …☆574Updated this week
- SGLang for GLM-5.3-Flash on two or four RTX PRO 6000 Blackwell GPUs (SM120), with TP2 W4A16 and TP4 NVIDIA NVFP4 profiles.☆48Oct 11, 2026Updated last month
- NVIDIA Fan Control Service tested on Ubuntu providing more aggressive fan curves for RTX Pro 6000 GPUs☆20Jan 17, 2026Updated 9 months ago
- Docker compose serving stack for DeepSeek v4 Flash DSpark for NVIDIA Spark GB10 system using Aidendle94 image☆33Aug 30, 2026Updated 2 months ago
- GLM-5.2 (744B/40B MoE) on a 4× DGX Spark / GB10 (sm_121) cluster: portable Triton sparse-MLA kernels, a data-free expert prune, MTP draft…☆37Aug 20, 2026Updated 2 months ago
- GLM-5.3-Flash EXL3 on 4x RTX PRO 6000 with TensorFold: one-command recipe and engine patches. By Aevonix Research in collaboration with M…☆11Oct 8, 2026Updated last month
- Know your VRAM before you run. Instant GPU memory estimates for any HuggingFace model.☆14Jan 7, 2026Updated 10 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Docker configuration for running VLLM on dual DGX Sparks☆2,489Updated this week
- LLM inference in C/C++☆56Aug 8, 2026Updated 3 months ago
- GLM-5.2-Int4-Int8 on 8x GB10 cluster☆39Jul 30, 2026Updated 3 months ago
- Optimized SGLang runtime for Qwen3.8-27B FP8 with DFlash2 and Qwen3.8 Flash-Next NVFP4 with FR-Spec on one NVIDIA RTX PRO 6000 Blackwell …☆199Updated this week
- A fork of jasl/vllm (codex/ds4-sm120-min-enable) with CPU-GPU hybrid inference support for DeepSeek-V4 on SM120+.☆32Sep 10, 2026Updated 2 months ago
- ☆21Oct 21, 2026Updated 3 weeks ago
- A local commit gate: runs the linters your repo configures, and sends changed code to an LLM for review☆13Updated this week
- Tool-calling quality benchmark for LLM serving stacks. 80+ deterministic scenarios testing multi-turn orchestration, safety boundaries, a…☆423Updated this week
- DeepSeek V4.1 Flash on 4x RTX PRO 6000 Blackwell: native weights, DSpark, vision, NVMe or locked RAM Engram offload.☆90Oct 17, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Serve EXL3 (ExLlamaV3 trellis) quantized models on vLLM fork runtimes — any architecture, mixed per-layer bitrates, composable with sourc…☆27Nov 5, 2026Updated last week
- DeepSeek-V4-Flash W4A16-FP8 quantization on 8x H200 — patches, recipe, mission report☆13Sep 26, 2026Updated last month
- Reproducible SGLang recipe + public prebuilt image (ghcr.io) for DeepSeek-V4-Flash-0731 on 4x RTX PRO 6000 Blackwell (SM120): TP4/DP4/EP4…☆21Aug 9, 2026Updated 3 months ago
- GLM-5.3-Flash NVFP4 on two or four DGX Sparks cabled as a ring, with no switch: the RiNGSiDE serving recipe☆30Sep 27, 2026Updated last month
- Apple Neural Engine on Linux: verified gemm/softmax/attention/transformer-block primitives, driven from Python on an M1 under Omarchy Mac☆20Updated this week
- Qwen3.6/3.8-27B on one RTX 5090: 576K pooled context across 12 sessions at FP8-level quality from 5.75 bpw. EXL3 trellis weights, 4-bit t…☆30Oct 23, 2026Updated 2 weeks ago
- Research MIL-to-HWX compiler for the M4 Apple Neural Engine☆18Sep 3, 2026Updated 2 months ago
- One-click LLM server with TurboQuant Llama CPP engine☆17Apr 16, 2026Updated 6 months ago
- Bajo los adoquines, la PLAYA 🏖️☆17Jul 3, 2026Updated 4 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- An electron Wrapper for Open-Interpreter for the lablab.ai hackathon☆12Oct 14, 2023Updated 3 years ago
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆16Oct 24, 2026Updated 2 weeks ago
- YesilDevCMS is based on BlizzCMS and it is specially adapted for VMaNGOS Core and includes new features and many bug fixes.☆11May 20, 2023Updated 3 years ago
- Sharing benchmarks from DGX stations☆28Sep 11, 2026Updated 2 months ago
- ☆20Updated this week
- Lsglang is a special extension of sglang that fully utilizes CPU and GPU computing resources with an efficient GPU parallel + NUMA parall…☆168Updated this week
- MiniMax M2 inference server for NVIDIA DGX Spark☆17Jan 24, 2026Updated 9 months ago
Are these results useful?