Docker images for LLM inference (SGLang + vLLM) on NVIDIA Blackwell GPUs (SM120, CUDA 13.2)
☆51Aug 3, 2026Updated this week
Alternatives and similar repositories for blackwell-llm-docker
Users that are interested in blackwell-llm-docker are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆154Updated this week
- LLM inference decode throughput benchmark with Rich TUI dashboard. Measures token generation speed across concurrency levels and context …☆62Jul 11, 2026Updated 3 weeks ago
- RTX 6000 Pro Wiki — Running Large LLMs (Qwen3.5-397B, Kimi-K2.5, GLM-5) on PCIe GPUs without NVLink☆763Updated this week
- LuaJIT binding to Zydis - Zyantific disassembly tools☆16Aug 7, 2018Updated 7 years ago
- Single-file, pure CUDA C implementation for running inference on Qwen3 0.6B GGUF. No Dependencies.☆24Nov 26, 2025Updated 8 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆20Jul 26, 2026Updated last week
- This is the repo with the code to conduct a comparative analysis of different audio representation models.☆11Aug 31, 2023Updated 2 years ago
- A vLLM patch + hand‑written SM120 SASS kernels: 2‑bit MoE experts + an FP4 "delta" cache that recovers precision — matching the official …☆491Updated this week
- ☆12Sep 9, 2024Updated last year
- These are performance benchmarks we did to prepare for our own privacy-preserving and NDA-compliant in-house AI coding assistant. If by a…☆32Apr 2, 2025Updated last year
- ☆22Jan 14, 2026Updated 6 months ago
- Optimized vLLM setup for Qwen3.6-27B-FP8 on dual RTX PRO 6000 Blackwell (192 GB GDDR7, no NVLink) ; config, benchmark sweep results, and …☆16May 10, 2026Updated 2 months ago
- Experimental implementation of DeepSeek v4 flaash in llama.cpp☆24Apr 30, 2026Updated 3 months ago
- The sample project of Multi-Factor Authentication with ASP.NET Core 2.0 & Identity Server 4☆14Sep 21, 2018Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A ziglang implementation of the SSZ serialization protocol☆34Jul 16, 2026Updated 2 weeks ago
- ☆12Jan 29, 2024Updated 2 years ago
- A script for MIDI/AUDIO routing in Max for Live devices.☆12Dec 27, 2024Updated last year
- A lightweight, high-performance AI/RAG workspace and autonomous agent framework implemented in Go. Inspired by the Leann RAG backend arch…☆36Updated this week
- Emulation Station for Windows 10☆11Apr 26, 2021Updated 5 years ago
- ☆13Apr 8, 2021Updated 5 years ago
- antirez/ds4-style hybrid quant DeepSeek V4 Flash on a single DGX Spark via vLLM☆16May 11, 2026Updated 2 months ago
- Naming policies for the system JSON serializer in .NET.☆16Jun 18, 2025Updated last year
- ☆23May 2, 2026Updated 3 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Organise your AI's memories with graph database entries☆79Dec 2, 2025Updated 8 months ago
- Protocol for Augmented Memory of Project Artifacts (MCP compatible) - extended☆24Jan 24, 2026Updated 6 months ago
- Polkadot Standard Transactions Per Second (sTPS) performance benchmarking☆19Feb 3, 2026Updated 6 months ago
- NVFP4 Gemma-4 26B-A4B MoE for DGX Spark — optimal recipe: DFlash n=10 (flex) on AEON vLLM Ultimate. 144 tok/s single / 1,724 peak (Coding…☆42Jun 28, 2026Updated last month
- Graphcast SDK allows you to build gossip-powered Radios☆16Nov 20, 2024Updated last year
- Bleeding edge vLLM Docker image for the NVIDIA DGX Spark (GB10 / sm_121a).☆41Updated this week
- Copier template for creating a Mopidy extension☆17May 16, 2026Updated 2 months ago
- vLLM Docker Container for Qwen3.6 27b☆51Jun 15, 2026Updated last month
- Patched NVIDIA GRID Drivers☆36May 1, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- An URL shortener☆12May 8, 2024Updated 2 years ago
- ☆33Sep 9, 2023Updated 2 years ago
- A tool used to evaluate the output of retrieval algorithms. Written in Rust.☆17Apr 13, 2020Updated 6 years ago
- Scitrera builds of various CUDA containers for version consistency, starting primarily with NVIDIA DGX Spark Containers☆36Updated this week
- ☆16Updated this week
- Open-Source Firmware for the Raspberry Pi UPS Solution☆21Jul 7, 2024Updated 2 years ago
- Controlling Ableton Live with TypeScript.☆15Apr 10, 2018Updated 8 years ago