Async PLE SSD offload for Qwen3.8 Flash Next on a 64 GiB SM80 GPU: vLLM patch, setup guide, and measured PP/TG results.
☆22Sep 24, 2026Updated last month
Alternatives and similar repositories for qwen3.8-flash-next-cmp170hx
Users that are interested in qwen3.8-flash-next-cmp170hx are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Qwen3.8-Flash-Next (W4A16) on 2x CMP 170HX: 110 tok/s decode, 7K prefill, 800 tok/s @ 23 concurrent - runs on 38 GB home RAM, no pinned m…☆21Sep 18, 2026Updated last month
- Qwen3.8-27B INT8 + DFlash2 on a rented CMP 170HX — failure analysis (private GHCR image prevented benchmark)☆17Aug 30, 2026Updated last month
- A cmpunlocker fork with working p2p on SYS-4028GR-TRT2☆26Aug 8, 2026Updated 2 months ago
- NInfer SM80 port for NVIDIA CMP 170HX☆28Aug 22, 2026Updated 2 months ago
- 双 SM80 / CMP 170HX 的 Qwen3.8-Flash-Next 社区 vLLM：NVIDIA NVFP4、GDS、TEP2、MTP6，支持 1～10 并发，词表与 PCIe 通信优化。中英文部署与可构建源码。☆28Oct 15, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Linux P2P unlock and performance fixes for NVIDIA CMP 170HX☆41Sep 22, 2026Updated last month
- A high-throughput and memory-efficient inference and serving engine for LLMs☆38Updated this week
- glm-5.2 on too many 64 / 80 GB A100's☆22Sep 9, 2026Updated last month
- Tuning and qualification harness for the NVIDIA CMP 170HX (GA100). Measures, gates and recovers clock/voltage settings, and treats a comp…☆91Sep 28, 2026Updated 3 weeks ago
- GLM-5.3-Flash on 4× NVIDIA CMP 170HX with vLLM: up to 482.6 tok/s single-user, up to 943.7 tok/s at 8 users, 262K context, TP4 or PP4, on…☆85Oct 16, 2026Updated last week
- Serve EXL3 (ExLlamaV3 trellis) quantized models on vLLM fork runtimes — any architecture, mixed per-layer bitrates, composable with sourc…☆26Updated this week
- vLLM for NVIDIA CMP 170HX (Ampere sm_80): fast, repeatable model serving on one card or several☆18Updated this week
- The original as far as I could find.☆14Feb 10, 2025Updated last year
- DeepSeek-V4-Flash-0731 on 4x CMP 170HX (sm_80): 98 tok/s decode, ~5300 tok/s prefill. DSpark speculative decoding under pipeline parallel…☆118Aug 13, 2026Updated 2 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- DeepSeek-V4.1-Flash (764B) on 4×CMP 170HX: PP4 + shadow KV + EXL3 2bpw + DSpark + 512k ctx + native vision — patches, recipes, acceptance…☆15Sep 29, 2026Updated 3 weeks ago
- Active4j-jsp是基于SpingBoot2.0轻量级的java快速开发框架。以Spring Framework为核心容器，Spring MVC为模型视图控制器，Mybatis Plus为数据访问层， Apache Shiro为权限授权层, Redis为分布式缓存，Q…☆15Feb 11, 2026Updated 8 months ago
- A tool to unlobotomize your NVIDIA card!☆791Oct 8, 2026Updated 2 weeks ago
- 🔐 Vaultwarden / Bitwarden MCP server for credential-aware AI agents☆24Updated this week
- Some Steam patches, fixing broken Steam features on Asus Rog Ally☆35Dec 10, 2024Updated last year
- GPUDirect Storage (GDS) for the NVIDIA CMP 170HX on modern Linux kernels (6.18+). nvidia-fs NVMe registration hooks for the new blk_rq_dm…☆18Aug 19, 2026Updated 2 months ago
- Google Hotels MCP server and Python library — reverse-engineered batchexecute client with FastMCP tools☆14Aug 24, 2026Updated 2 months ago
- Not insane. Designed to read WDB files from the latest World of Warcraft builds and output CSV files. Could be used as a library by other…☆15Sep 27, 2025Updated last year
- A fork of jasl/vllm (codex/ds4-sm120-min-enable) with CPU-GPU hybrid inference support for DeepSeek-V4 on SM120+.☆31Sep 10, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Dogfooding vLLM backport for older GPUs.☆333Updated this week
- A simple PCB adapter for use on a SuperFX or CX4 donor cart☆11Sep 21, 2025Updated last year
- Compilation of stuff for the ROG ALLY (and ALLY X) when using Nobara☆33Dec 29, 2024Updated last year
- A laptop keyboard reverse-engineering helper☆14Jun 12, 2022Updated 4 years ago
- 1Cat-vLLM on Intel Gaudi☆43Oct 12, 2026Updated last week
- ☆16Updated this week
- Android chroot guide + other useful scripts☆13Jul 28, 2025Updated last year
- Chrome extension that displays your bookmarks on a new tab page☆14Aug 13, 2024Updated 2 years ago
- Multi-host plugin for delegating tasks and code reviews to Google Antigravity CLI (agy). Successor to gemini-plugin-cc. Works in Claude C…☆23May 22, 2026Updated 5 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- SEGA Dreamcast BIOS files☆15Sep 2, 2024Updated 2 years ago
- ☆18Aug 26, 2025Updated last year
- A clean and simple solution to replace the massive ribbon cable in the PCE and Core Grafx.☆15Aug 25, 2025Updated last year
- Agentic-coding oriented inference engine for N x V100-SXM2, based on SGLang: GLM-5.3-Flash, Qwen3.8-Flash-Next, DeepSeek-V4.1-Flash, Mini…☆33Oct 7, 2026Updated 2 weeks ago
- Userspace driver for Samsung Gear VR Controller☆14Nov 9, 2019Updated 6 years ago
- A Chrome Extension to make a Google Calendar event from a selection of text.☆11Mar 13, 2018Updated 8 years ago
- Dragonflight_Dekk-Core☆19Dec 23, 2023Updated 2 years ago