Qwen3.8-Flash-Next (W4A16) on 2x CMP 170HX: 110 tok/s decode, 7K prefill, 800 tok/s @ 23 concurrent - runs on 38 GB home RAM, no pinned memory
☆21Sep 18, 2026Updated last month
Alternatives and similar repositories for qwen38-flash-next-w4a16-cmp170hx
Users that are interested in qwen38-flash-next-w4a16-cmp170hx are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 双 SM80 / CMP 170HX 的 Qwen3.8-Flash-Next 社区 vLLM：NVIDIA NVFP4、GDS、TEP2、MTP6，支持 1～10 并发，词表与 PCIe 通信优化。中英文部署与可构建源码。☆28Oct 15, 2026Updated last week
- Async PLE SSD offload for Qwen3.8 Flash Next on a 64 GiB SM80 GPU: vLLM patch, setup guide, and measured PP/TG results.☆22Sep 24, 2026Updated last month
- Linux P2P unlock and performance fixes for NVIDIA CMP 170HX☆41Sep 22, 2026Updated last month
- Qwen3.8-27B INT8 + DFlash2 on a rented CMP 170HX — failure analysis (private GHCR image prevented benchmark)☆17Aug 30, 2026Updated last month
- A cmpunlocker fork with working p2p on SYS-4028GR-TRT2☆26Aug 8, 2026Updated 2 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- NInfer SM80 port for NVIDIA CMP 170HX☆28Aug 22, 2026Updated 2 months ago
- DeepSeek-V4.1-Flash (764B) on 4×CMP 170HX: PP4 + shadow KV + EXL3 2bpw + DSpark + 512k ctx + native vision — patches, recipes, acceptance…☆15Sep 29, 2026Updated 3 weeks ago
- Community-tested recipes, diagnostics, and benchmarks for CMP 170HX AI workloads☆89Updated this week
- Unlock tool for the NVIDIA CMP 170HX (GA100) mining card. Restores full A100 compute throughput by exploiting the Falcon BootROM .fwsigna…☆57Jul 30, 2026Updated 2 months ago
- A tool to unlobotomize your NVIDIA card!☆791Oct 8, 2026Updated 2 weeks ago
- vLLM for NVIDIA CMP 170HX (Ampere sm_80): fast, repeatable model serving on one card or several☆18Updated this week
- finetune the chain model based on cvte open source model without traing any GMM for frame alignment☆12Aug 6, 2020Updated 6 years ago
- ☆42Sep 30, 2026Updated 3 weeks ago
- Flash Attention v2 for Pascal (P100, GTX 1080) and Volta (V100) GPUs — bringing O(N) memory attention to hardware the official flash-attn…☆27Apr 4, 2026Updated 6 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- The original as far as I could find.☆14Feb 10, 2025Updated last year
- Active4j-jsp是基于SpingBoot2.0轻量级的java快速开发框架。以Spring Framework为核心容器，Spring MVC为模型视图控制器，Mybatis Plus为数据访问层， Apache Shiro为权限授权层, Redis为分布式缓存，Q…☆15Feb 11, 2026Updated 8 months ago
- Dogfooding vLLM backport for older GPUs.☆333Updated this week
- CMP 170HX technical wiki: silicon, firmware, the community unlock, procedures and open problems. 55 pages.☆73Aug 22, 2026Updated 2 months ago
- Not insane. Designed to read WDB files from the latest World of Warcraft builds and output CSV files. Could be used as a library by other…☆15Sep 27, 2025Updated last year
- GLM-5.3-Flash on 4× NVIDIA CMP 170HX with vLLM: up to 482.6 tok/s single-user, up to 943.7 tok/s at 8 users, 262K context, TP4 or PP4, on…☆85Oct 16, 2026Updated last week
- Libegpu is a library for enumerating eGPU devices & enclosures.☆17Nov 24, 2025Updated 11 months ago
- DeepSeek-V4-Flash-0731 on 4x CMP 170HX (sm_80): 98 tok/s decode, ~5300 tok/s prefill. DSpark speculative decoding under pipeline parallel…☆118Aug 13, 2026Updated 2 months ago
- glm-5.2 on too many 64 / 80 GB A100's☆22Sep 9, 2026Updated last month
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆18Aug 26, 2025Updated last year
- The most comprehensive community resource for the NVIDIA CMP 170HX.☆128Jul 30, 2026Updated 2 months ago
- Zero downtime embedding upgrades☆55Sep 15, 2026Updated last month
- Automated literature reviews using local LLMs via Ollama. Searches academic databases, acquires full-text papers, and writes APA 7th revi…☆39Sep 9, 2026Updated last month
- MCP server for file operations on non-UTF-8 text: detects the encoding from the bytes, hands the model UTF-8, and writes back in the orig…☆26Updated this week
- Dragonflight_Dekk-Core☆19Dec 23, 2023Updated 2 years ago
- wxautox4 免授权封装 — 改一行 import，省几百 块授权费☆66Aug 3, 2026Updated 2 months ago
- 绕过网络限制，一键安装 Claude Desktop 并修复 Host Claude Code binary not available 问题。☆89Aug 24, 2026Updated 2 months ago
- Docker compose serving stack for DeepSeek v4 Flash DSpark for NVIDIA Spark GB10 system using Aidendle94 image☆33Aug 30, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Run Faster-Qwen3-TTS on NVIDIA DGX Spark GB10 (ARM64/SM121/CUDA13) - OpenAI-compatible TTS API with CUDA graph acceleration☆28Oct 11, 2026Updated last week
- 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.☆14Sep 1, 2025Updated last year
- Bancor Protocol Contracts☆16Dec 24, 2018Updated 7 years ago
- ☆21May 8, 2026Updated 5 months ago
- ☆21Jan 31, 2025Updated last year
- 10.1.0.49801☆25Aug 21, 2024Updated 2 years ago
- OpenCore EFI for X79 Mainboard and CPU xeon E5 2650v2 RX470☆20Feb 1, 2021Updated 5 years ago