Docker images for LLM inference (SGLang + vLLM) on NVIDIA Blackwell GPUs (SM120, CUDA 13.2)
☆83Sep 30, 2026Updated this week
Alternatives and similar repositories for blackwell-llm-docker
Users that are interested in blackwell-llm-docker are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆270Updated this week
- LLM inference decode throughput benchmark with Rich TUI dashboard. Measures token generation speed across concurrency levels and context …☆107Updated this week
- Lightweight C inference for Qwen3 GGUF. Multiturn prefix caching & batch processing.☆26Sep 1, 2025Updated last year
- A vLLM patch + hand‑written SM120 SASS kernels: 2‑bit MoE experts + an FP4 "delta" cache that recovers precision — matching the official …☆541Updated this week
- ☆12Sep 9, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- These are performance benchmarks we did to prepare for our own privacy-preserving and NDA-compliant in-house AI coding assistant. If by a…☆32Apr 2, 2025Updated last year
- DGX Spark research and tests - containers, benchmarks, and investigation notes for running models on GB10 (SM 12.1)☆28Aug 6, 2026Updated last month
- A clean and simple solution to replace the massive ribbon cable in the PCE and Core Grafx.☆15Aug 25, 2025Updated last year
- A ziglang implementation of the SSZ serialization protocol☆34Sep 1, 2026Updated last month
- Python Bootcamp Materials☆11Dec 1, 2021Updated 4 years ago
- A lightweight, high-performance AI/RAG workspace and autonomous agent framework implemented in Go. Inspired by the Leann RAG backend arch…☆38Sep 25, 2026Updated last week
- Pi extension that tracks bash tool token usage with live stats, grouping, and export☆23Feb 10, 2026Updated 7 months ago
- ☆13Apr 8, 2021Updated 5 years ago
- Protocol for Augmented Memory of Project Artifacts (MCP compatible) - extended☆23Jan 24, 2026Updated 8 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Graphcast SDK allows you to build gossip-powered Radios☆16Nov 20, 2024Updated last year
- ☆30May 2, 2026Updated 5 months ago
- vLLM Docker Container for the latest Qwen 27b☆52Updated this week
- An efficent mining turtle program for creating large underground builds in Minecraft.☆12Sep 3, 2025Updated last year
- An URL shortener☆12May 8, 2024Updated 2 years ago
- ☆33Sep 9, 2023Updated 3 years ago
- A tool used to evaluate the output of retrieval algorithms. Written in Rust.☆17Apr 13, 2020Updated 6 years ago
- ☆17Aug 13, 2026Updated last month
- SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86, 2× A5000/3090). Qwen3.6-35…☆133Updated this week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Surgical GPU kernel benchmark: 7 hard problems, frontier coding agents, roofline-graded against hardware peak.☆19Jun 12, 2026Updated 3 months ago
- FlashQLA TileLang GDN kernels ported to NVIDIA Blackwell consumer (GB10 / DGX Spark)☆18Jun 5, 2026Updated 3 months ago
- Serving and fine-tuning for the Gemma 4 and Qwen3.6 model families on Modal (SGLang/vLLM) — solo and concurrent shapes, custom chat-templ…☆34Jul 4, 2026Updated 2 months ago
- End-to-end tests for ink! ➜ cargo-contract ➜ canvas-ui || polkadot-js ➜ substrate-contracts-node.☆16Dec 8, 2023Updated 2 years ago
- Rust-based Indexer for a NEAR blockchain☆15Sep 26, 2026Updated last week
- JavaScript component to parse, clean, remove formatting (unformat) numbers in strings.☆10Dec 5, 2024Updated last year
- Exciting Showcase! My C# Unity Classes for a Google Firebase Database with UI handling and Authentication☆11May 8, 2023Updated 3 years ago
- Public Audits in the NEAR Ecosystem☆17Jun 10, 2024Updated 2 years ago
- ☆14Mar 16, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- VellumForge2 is a Golang CLI for generating high-quality Direct Preference Optimization datasets via a hierarchical prompt pipeline with …☆22Feb 15, 2026Updated 7 months ago
- Python class for the Ender 3 V2 LCD☆26Jan 6, 2023Updated 3 years ago
- NVIDIA Fan Control Service tested on Ubuntu providing more aggressive fan curves for RTX Pro 6000 GPUs☆19Jan 17, 2026Updated 8 months ago
- Dockerfiles that compile the Valhalla routing engine from source☆20Sep 20, 2026Updated last week
- One-Click RAG Implementation, Simple and Portable☆30Sep 22, 2026Updated last week
- Tencent Hunyuan 3 (295B MoE) on 2x NVIDIA DGX Spark: NVFP4 W4A16 + native MTP speculative decoding. First published MTP-on-GB10 numbers, …☆19Jul 13, 2026Updated 2 months ago
- ☆25Dec 21, 2024Updated last year