Docker images for LLM inference (SGLang + vLLM) on NVIDIA Blackwell GPUs (SM120, CUDA 13.2)
☆92Oct 20, 2026Updated this week
Alternatives and similar repositories for blackwell-llm-docker
Users that are interested in blackwell-llm-docker are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM inference decode throughput benchmark with Rich TUI dashboard. Measures token generation speed across concurrency levels and context …☆120Oct 13, 2026Updated last week
- Archived: b12x development has moved to FlashInfer. See README for migration and PR-porting guidance.☆268Oct 6, 2026Updated 2 weeks ago
- RTX 6000 Pro Wiki — Running Large LLMs (Qwen3.5-397B, Kimi-K2.5, GLM-5) on PCIe GPUs without NVLink☆1,148Updated this week
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆24Oct 13, 2026Updated last week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆42Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆37Apr 26, 2026Updated 5 months ago
- Qwen3.8-Flash-Next optimized for 1x RTX Pro 6000☆19Sep 17, 2026Updated last month
- NVIDIA Fan Control Service tested on Ubuntu providing more aggressive fan curves for RTX Pro 6000 GPUs☆19Jan 17, 2026Updated 9 months ago
- Sharing benchmarks from DGX stations☆27Sep 11, 2026Updated last month
- Optimized SGLang runtime for Qwen3.8-27B FP8 with DFlash2 and Qwen3.8 Flash-Next NVFP4 with FR-Spec on one NVIDIA RTX PRO 6000 Blackwell …☆175Updated this week
- ☆21Aug 17, 2026Updated 2 months ago
- DeepSeek V4.1 Flash on 4x RTX PRO 6000 Blackwell: native weights, DSpark, vision, NVMe or locked RAM Engram offload.☆77Updated this week
- A vLLM patch + hand‑written SM120 SASS kernels: 2‑bit MoE experts + an FP4 "delta" cache that recovers precision — matching the official …☆545Updated this week
- GLM-5.3-Flash NVFP4 on two or four DGX Sparks cabled as a ring, with no switch: the RiNGSiDE serving recipe☆30Sep 27, 2026Updated 3 weeks ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Pi extension that tracks bash tool token usage with live stats, grouping, and export☆23Feb 10, 2026Updated 8 months ago
- Personal pi agent setup☆16Mar 16, 2026Updated 7 months ago
- Docker compose serving stack for DeepSeek v4 Flash DSpark for NVIDIA Spark GB10 system using Aidendle94 image☆33Aug 30, 2026Updated last month
- RTX 6000 96GB/Spark 128GB vLLM Recipe for Qwen 3.8 Flash Next☆22Sep 8, 2026Updated last month
- An electron Wrapper for Open-Interpreter for the lablab.ai hackathon☆12Oct 14, 2023Updated 3 years ago
- Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input a target size and the toolchain w…☆170Sep 11, 2026Updated last month
- Besok3d is an app store and package manager for Klipper 3D printers. Install plugins, adapters, and features with one tap. No terminal, n…☆46Updated this week
- ☆23Aug 29, 2026Updated last month
- ☆64Jul 27, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A Go CLI tool to benchmark local LLMs via Ollama, measuring Time To First Token (TTFT) and throughput on your specific hardware.☆21Feb 24, 2026Updated 7 months ago
- Dynamic LLM model swapping system with Docker, vLLM integration, and GPU acceleration. Supports GGUF & Hugging Face models with automatic…☆23Mar 6, 2026Updated 7 months ago
- A proxy for minimax-m2, enabling interleaved thinking, and tool calls.☆38Nov 21, 2025Updated 11 months ago
- ☆31Aug 26, 2026Updated last month
- ☆12Sep 9, 2024Updated 2 years ago
- Zero-dependency Web Bluetooth driver + reverse-engineered protocol docs to print Niimbot label printers straight from the browser — no ap…☆36Oct 7, 2026Updated 2 weeks ago
- LLMs take the path of least resistance. Pre-Reasoning hands any model a map of the problem first, so it unlocks the knowledge it already …☆19Sep 21, 2026Updated last month
- These are performance benchmarks we did to prepare for our own privacy-preserving and NDA-compliant in-house AI coding assistant. If by a…☆32Apr 2, 2025Updated last year
- Build different debian suites for the radxa rock 4 se☆12Mar 11, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A fancontroller for Supermicro boards using IPMI raw commands☆16Oct 20, 2024Updated 2 years ago
- DeepSeek-V4-Flash on Ampere SM 8.6 via vLLM (pyref kernel replacements)☆35Jul 2, 2026Updated 3 months ago
- Nemotron Speech ASR Docker deployment☆31Jun 7, 2026Updated 4 months ago
- ☆12Oct 9, 2023Updated 3 years ago
- ☆22Jan 14, 2026Updated 9 months ago
- ☆12Jan 29, 2024Updated 2 years ago
- Pure-Rust WebGPU inference engine for GGUF models. No C++, no Python, no llama.cpp. Runs on NVIDIA, AMD, Intel, and Apple Silicon.☆20Updated this week