Optimized SGLang runtime for Qwen3.8-27B FP8 with DFlash2 and Qwen3.8 Flash-Next NVFP4 with FR-Spec on one NVIDIA RTX PRO 6000 Blackwell 96 GB GPU (SM120): 524K context, HiCache and NIXL.
☆194Nov 6, 2026Updated this week
Alternatives and similar repositories for sglang-rtxpro6000
Users that are interested in sglang-rtxpro6000 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Qwen3.8-Flash-Next 180B NVFP4 @ 231 tok/s on one RTX PRO 6000 Blackwell (sm120) - sglang patches, launchers, full optimization analysis☆30Aug 31, 2026Updated 2 months ago
- RTX 6000 96GB/Spark 128GB vLLM Recipe for Qwen 3.8 Flash Next☆23Sep 8, 2026Updated last month
- RTX 6000 Pro Wiki — Running Large LLMs (Qwen3.5-397B, Kimi-K2.5, GLM-5) on PCIe GPUs without NVLink☆1,186Updated this week
- Qwen3.8-Flash-Next (176B MoE) on a single RTX PRO 6000 Blackwell 96GB — NVMe-streamed PLE table, CUDA graphs with NEXTN speculation, meas…☆10Aug 28, 2026Updated 2 months ago
- Validated GLM-5.3 Flash recipe for 2x NVIDIA RTX PRO 6000 Blackwell 96GB: 262K context, EXL3/TR3, adaptive MTP, tools, and vision.☆62Sep 20, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Qwen3.8-27B on 2× RTX 5090 · 1.49M KV · code/prose t/s: c1 264/216, c16 2,649/2,240 · NVFP4 + vLLM + MTP☆26Oct 21, 2026Updated 2 weeks ago
- SGLang for GLM-5.3-Flash on two or four RTX PRO 6000 Blackwell GPUs (SM120), with TP2 W4A16 and TP4 NVIDIA NVFP4 profiles.☆48Oct 11, 2026Updated 3 weeks ago
- DeepSeek V4.1 Flash on 4x RTX PRO 6000 Blackwell: native weights, DSpark, vision, NVMe or locked RAM Engram offload.☆85Oct 17, 2026Updated 2 weeks ago
- SGLang 0.5.21 for Qwen3.8-Flash-Next on one RTX PRO 6000: 264.5 tok/s decode, W4A16 routed experts (KLD 0.0111 vs BF16), 262K context, ex…☆18Oct 26, 2026Updated last week
- Frontier MoE models on RTX PRO 6000 / RTX 5090 (sm_120): DeepSeek-V4.1-Flash on 4x RTX PRO 6000, as a GPU+CPU hybrid on 4x RTX 5090, and …☆568Updated this week
- Native DeepSeek V4.1 Flash inference across one RTX PRO 6000 and four DGX Spark expert workers☆39Sep 25, 2026Updated last month
- A Playwright-based Python tool that bypasses Google's anti-bot mechanisms to execute searches, serving as both a command-line tool and MC…☆16Apr 2, 2026Updated 7 months ago
- Docker images for LLM inference (SGLang + vLLM) on NVIDIA Blackwell GPUs (SM120, CUDA 13.2)☆98Oct 20, 2026Updated 2 weeks ago
- GLM-5.3-Flash (EXL3 4bpw + DFlash2) on 2x NVIDIA DGX Spark: one-shot installer, 33-74 tok/s c1, 1.3M+ context, vision☆43Sep 2, 2026Updated 2 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- GLM-5.3-Flash NVFP4 (lab quant) on 2x DGX Spark — TP=2 over RoCE, one .env, compose head/worker, download/start/stop/status/tail-log☆11Sep 8, 2026Updated last month
- A powerful & efficient browser agent that automates any task on the web☆24Aug 28, 2026Updated 2 months ago
- ARC-AGI-3 Milestone 2 solution built on Tufa Labs’ Duck harness, with improved agent tools, compute scheduling, and SGLang serving.☆17Sep 30, 2026Updated last month
- experiment in performant nvfp4 inference on DGX Spark☆27Oct 22, 2026Updated 2 weeks ago
- LLM inference decode throughput benchmark with Rich TUI dashboard. Measures token generation speed across concurrency levels and context …☆124Updated this week
- GLM-5.3-Flash EXL3 (320B MoE) on 2x NVIDIA DGX Spark — production serving kit, 1M context, 97%+ multi-session prefix caching, DFlash2 spe…☆64Updated this week
- NVFP4 KV cache for vLLM on SM120 (RTX PRO 6000) via FlashInfer FA2 explicit-SF-stride patch — ~1.5x fp8 pool at ~95-104% speed☆20Jun 5, 2026Updated 5 months ago
- ☆31Aug 28, 2026Updated 2 months ago
- DeepSeek-v4-Flash 0731 recipe for 2x DGX Sparks☆1,511Oct 4, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆37Apr 26, 2026Updated 6 months ago
- Fastest MoE/LLM inference runtime for consumer and edge Blackwell GPUs. SN74 on Gittensor.☆93Oct 11, 2026Updated 3 weeks ago
- vLLM inference solutions for NVIDIA GB10 (DGX Spark, sm121) — KIMI-K3 B12X_MLA + DSpark, GLM-5.2☆68Sep 30, 2026Updated last month
- Optimized SGLang MoE kernel configs for NVIDIA DGX Spark (GB10) - GLM-4.7-FP8 and other MoE models☆13Feb 7, 2026Updated 8 months ago
- ☆780Updated this week
- Offline LLM app for iPhone: run open models from Hugging Face on-device with llama.cpp, MLX, Core ML and Apple Foundation Models. No acco…☆13Updated this week
- ☆24Dec 29, 2025Updated 10 months ago
- 限制问题区域显存 62906MiB / 65024MiB 支持驱动 610.57.04 ，修改显卡显示名称为NVIDIA Tesla A100☆13Aug 30, 2026Updated 2 months ago
- Developing K - a language model to generate OPENSCAD code from prompt☆19Dec 3, 2025Updated 11 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Archived VySol V1 prototype — local-first GraphRAG app with ingestion, graph extraction, entity resolution, embeddings, and graph-backed …☆16May 3, 2026Updated 6 months ago
- Claude Code skill: let your agent drive fleets of local omp (oh-my-pi) model instances toward one goal — provider config, bounded turns, …☆15Aug 28, 2026Updated 2 months ago
- MRS-Core provides a transparent, modular, reproducible reasoning substrate.☆11Feb 3, 2026Updated 9 months ago
- Archived: b12x development has moved to FlashInfer. See README for migration and PR-porting guidance.☆270Oct 6, 2026Updated last month
- thumbnails☆12Nov 9, 2024Updated last year
- Serve Qwen3.8-Flash-Next (turboderp ExLlamaV3 pack) on one NVIDIA DGX Spark with exllamav3☆64Oct 14, 2026Updated 3 weeks ago
- Give text-only LLMs vision. A tiny OpenAI-compatible proxy that lets reasoning models (DeepSeek, Qwen, GLM…) see images by querying a sep…☆49Jul 7, 2026Updated 3 months ago