双 SM80 / CMP 170HX 的 Qwen3.8-Flash-Next 社区 vLLM：NVIDIA NVFP4、GDS、TEP2、MTP6，支持 1～10 并发，词表与 PCIe 通信优化。中英文部署与可构建源码。
☆28Oct 15, 2026Updated 3 weeks ago
Alternatives and similar repositories for Qwen-Flash-SM80-170HX
Users that are interested in Qwen-Flash-SM80-170HX are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Qwen3.8-27B INT8 + DFlash2 on a rented CMP 170HX — failure analysis (private GHCR image prevented benchmark)☆17Aug 30, 2026Updated 2 months ago
- Qwen3.8-Flash-Next (W4A16) on 2x CMP 170HX: 110 tok/s decode, 7K prefill, 800 tok/s @ 23 concurrent - runs on 38 GB home RAM, no pinned m…☆20Sep 18, 2026Updated last month
- Linux P2P unlock and performance fixes for NVIDIA CMP 170HX☆39Sep 22, 2026Updated last month
- Community-tested recipes, diagnostics, and benchmarks for CMP 170HX AI workloads☆99Updated this week
- NInfer SM80 port for NVIDIA CMP 170HX☆29Aug 22, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- DeepSeek-V4.1-Flash on 4× NVIDIA CMP 170HX with vLLM: up to 297 tok/s for one user, up to 868 tok/s at eight, 262K context, one-command c…☆31Nov 2, 2026Updated last week
- DeepSeek-V4.1-Flash (764B) on 4×CMP 170HX: PP4 + shadow KV + EXL3 2bpw + DSpark + 512k ctx + native vision — patches, recipes, acceptance…☆15Sep 29, 2026Updated last month
- vLLM for NVIDIA CMP 170HX (Ampere sm_80): fast, repeatable model serving on one card or several☆28Nov 2, 2026Updated last week
- DeepSeek-V4-Flash-0731 on 4x CMP 170HX (sm_80): 98 tok/s decode, ~5300 tok/s prefill. DSpark speculative decoding under pipeline parallel…☆119Aug 13, 2026Updated 3 months ago
- A cmpunlocker fork with working p2p on SYS-4028GR-TRT2☆27Aug 8, 2026Updated 3 months ago
- Async PLE SSD offload for Qwen3.8 Flash Next on a 64 GiB SM80 GPU: vLLM patch, setup guide, and measured PP/TG results.☆23Sep 24, 2026Updated last month
- 在四卡A100上适配Sglang部署deepseek-v4-flash正式版模型☆15Aug 2, 2026Updated 3 months ago
- A tool to unlobotomize your NVIDIA card!☆841Oct 28, 2026Updated 2 weeks ago
- GLM-5.3-Flash on 4× NVIDIA CMP 170HX with vLLM: up to 482.6 tok/s single-user, up to 943.7 tok/s at 8 users, 262K context, TP4 or PP4, on…☆90Oct 26, 2026Updated 2 weeks ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- 解锁自有 NVIDIA CMP 170HX / 90HX 的算力限制。Linux x86-64，需要 root。☆62Aug 6, 2026Updated 3 months ago
- Dogfooding vLLM backport for older GPUs.☆362Updated this week
- GA100 voltage glitch resources☆136Updated this week
- some experiments about 170hx 10g version.☆11Oct 19, 2026Updated 3 weeks ago
- Tuning and qualification harness for the NVIDIA CMP 170HX (GA100). Measures, gates and recovers clock/voltage settings, and treats a comp…☆98Sep 28, 2026Updated last month
- 适配泰安S8030显卡机自动调节系统风扇组件☆13Dec 13, 2024Updated last year
- Modified sdr transciever for digital and analog modes include Tetra-TMO☆13Jun 22, 2026Updated 4 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆38Nov 4, 2026Updated last week
- A laptop keyboard reverse-engineering helper☆14Jun 12, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 170hx-pve-gen2-controller☆11Aug 20, 2026Updated 2 months ago
- Agnost GitOps Helm charts☆13Dec 9, 2025Updated 11 months ago
- Uncensored Qwen3.8-27B Ultimate - BF16 master + NVFP4-MIXED deploy. QuickStarts for DGX Spark (one Dynamic DFlash lattice seat @ util 0.8…☆21Updated this week
- Simple "Oscilloscope" on CH32V003J4M6☆16Dec 17, 2024Updated last year
- Android chroot guide + other useful scripts☆13Jul 28, 2025Updated last year
- ☆15Sep 27, 2024Updated 2 years ago
- ☆18Aug 26, 2025Updated last year
- Distillation pipeline from pretrained Transformers to customized FLA models☆13Aug 4, 2025Updated last year
- 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.☆10Nov 19, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆21Aug 21, 2023Updated 3 years ago
- Updated Langstone transceiver with Lime SDR and Adalm Pluto support☆18Dec 14, 2025Updated 10 months ago
- EBAZ4205 and AD9226 as a 0-32 MHz radio spectrum viewer☆17Dec 8, 2022Updated 3 years ago
- Dragonflight_Dekk-Core☆20Dec 23, 2023Updated 2 years ago
- Sol-Attn (arXiv 2607.24027) sparse acceleration for MiniMax H3 on V100 — single-node ComfyUI plugin (embedded FP16Safe + keep-or-drop ker…☆34Aug 29, 2026Updated 2 months ago
- Tries to UI development. Clone of https://www.perplexity.ai/☆11Sep 30, 2023Updated 3 years ago
- GPUDirect Storage (GDS) for the NVIDIA CMP 170HX on modern Linux kernels (6.18+). nvidia-fs NVMe registration hooks for the new blk_rq_dm…☆18Aug 19, 2026Updated 2 months ago
Are these results useful?