SGLang for GLM-5.3-Flash on two or four RTX PRO 6000 Blackwell GPUs (SM120), with TP2 W4A16 and TP4 NVIDIA NVFP4 profiles.
☆48Oct 11, 2026Updated last month
Alternatives and similar repositories for sglang-glm53-flash-sm120
Users that are interested in sglang-glm53-flash-sm120 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Reproducible SGLang image for DeepSeek-V4-Flash-0731 on SM120☆38Aug 25, 2026Updated 2 months ago
- Validated GLM-5.3 Flash recipe for 2x NVIDIA RTX PRO 6000 Blackwell 96GB: 262K context, EXL3/TR3, adaptive MTP, tools, and vision.☆63Sep 20, 2026Updated last month
- RTX 6000 Pro Wiki — Running Large LLMs (Qwen3.5-397B, Kimi-K2.5, GLM-5) on PCIe GPUs without NVLink☆1,201Updated this week
- LLM inference decode throughput benchmark with Rich TUI dashboard. Measures token generation speed across concurrency levels and context …☆129Nov 4, 2026Updated last week
- DeepSeek-V4.1-Flash-1017 on NVIDIA DGX Sparks with TensorFold + EXL3: TP4 (4 Sparks, 93.6 tok/s, 1M context) and TP2 (2 Sparks, 73 tok/s)…☆163Oct 26, 2026Updated 2 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆37Apr 26, 2026Updated 6 months ago
- Docker images for LLM inference (SGLang + vLLM) on NVIDIA Blackwell GPUs (SM120, CUDA 13.2)☆100Oct 20, 2026Updated 3 weeks ago
- GLM-5.3-Flash (EXL3 4bpw + DFlash2) on 2x NVIDIA DGX Spark: one-shot installer, 33-74 tok/s c1, 1.3M+ context, vision☆43Sep 2, 2026Updated 2 months ago
- Frontier MoE models on RTX PRO 6000 / RTX 5090 (sm_120): DeepSeek-V4.1-Flash on 4x RTX PRO 6000, as a GPU+CPU hybrid on 4x RTX 5090, and …☆574Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆47Oct 27, 2026Updated 2 weeks ago
- Optimized SGLang runtime for Qwen3.8-27B FP8 with DFlash2 and Qwen3.8 Flash-Next NVFP4 with FR-Spec on one NVIDIA RTX PRO 6000 Blackwell …☆199Updated this week
- Freedesktop-compliant trashcan implemented in bash script☆12Nov 6, 2011Updated 15 years ago
- Fork of Synergy that allows for support of Chrome OS/Android using an HID☆10Mar 13, 2019Updated 7 years ago
- Archived VySol V1 prototype — local-first GraphRAG app with ingestion, graph extraction, entity resolution, embeddings, and graph-backed …☆16May 3, 2026Updated 6 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Minimal read-only OS image for GB10 (DGX Spark / ASUS GX10) boxes☆97Updated this week
- Tencent Hy3 295B MoE (NVFP4) on 2x NVIDIA DGX Spark — TP2 over 200GbE, 256K context, 26 tok/s end-to-end. Tuned, benchmarked, agent-ready…☆14Jul 7, 2026Updated 4 months ago
- Code for STM32 on the UltraPIF☆14Feb 3, 2024Updated 2 years ago
- Open source hardware membrane and PCB☆10May 30, 2023Updated 3 years ago
- Make powerline/nerd fonts available as web fonts.☆12May 4, 2019Updated 7 years ago
- A simple PCB adapter for use on a SuperFX or CX4 donor cart☆12Sep 21, 2025Updated last year
- A powerful & efficient browser agent that automates any task on the web☆25Aug 28, 2026Updated 2 months ago
- DeepSeek v4.1 Flash EXL3 2.9 bpw for 2x DGX Sparks☆283Sep 19, 2026Updated last month
- Qwen3.8-Flash-Next optimized for 1x RTX Pro 6000☆20Sep 17, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- The most complete abliteration handbook on the internet: every method, setup, bleeding-edge technique, and script for LLM refusal-directi…☆15Updated this week
- Multiple hotbars for Minecraft☆14Mar 26, 2019Updated 7 years ago
- Interactive JSONL editor for Claude Code conversation files with real-time file system synchronization. Efficient prompt engineering thro…☆15Oct 22, 2026Updated 3 weeks ago
- Qwen 3.8 Flash NVFP4 with PLE NVFP4 quantized to run on a single DGX Spark☆15Aug 28, 2026Updated 2 months ago
- Local-first Android voice notes with live on-device transcription, transcript cleanup, titles, and summaries powered by Nemotron ASR and …☆15Jul 16, 2026Updated 3 months ago
- Browser-based operator console for managing and monitoring Lemonade on Linux inference servers.☆23Updated this week
- ☆17Oct 20, 2026Updated 3 weeks ago
- Generate and execute fuzzing campaign commands for AFL++ based on the recommended multi-core secondary fuzzer options.☆11Jan 12, 2024Updated 2 years ago
- Automates Flatcam generation of G-code for my (and maybe your) PCB milling process☆10Jun 16, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A self-hosted control plane for a DGX Spark GPU cluster: provision nodes over SSH or a join token, deploy and serve inference behind one …☆13Oct 23, 2026Updated 2 weeks ago
- DeepSeek-V4.1-Flash EXL3 on 2x DGX Spark (GB10) with the TensorFold engine, TP=2☆13Oct 10, 2026Updated last month
- Qwen3.8-Flash-Next (176B MoE) on a single RTX PRO 6000 Blackwell 96GB — NVMe-streamed PLE table, CUDA graphs with NEXTN speculation, meas…☆10Aug 28, 2026Updated 2 months ago
- A clean and simple solution to replace the massive ribbon cable in the PCE and Core Grafx.☆16Aug 25, 2025Updated last year
- A plugin for declaring deep/shallow computed observation☆15Jan 7, 2023Updated 3 years ago
- AmiiboTap is a tool for clone amiibo NFC tags using PN532 NFC reader/writer with libnfc.☆15Dec 7, 2022Updated 3 years ago
- GLM-5.3-Flash EXL3 K2 2.33bpw on ONE DGX Spark: native MTP (layer 45, 288 experts), CUDA graphs on, full 262,144 ctx. Measured ~19 tok/s …☆10Sep 19, 2026Updated last month
Are these results useful?