DeepSeek-V4-Flash-0731 on 4x CMP 170HX (sm_80): 98 tok/s decode, ~5300 tok/s prefill. DSpark speculative decoding under pipeline parallelism, which vLLM does not support upstream.
☆118Aug 13, 2026Updated 2 months ago
Alternatives and similar repositories for deepseek-v4-cmp170hx
Users that are interested in deepseek-v4-cmp170hx are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- DeepSeek-V4.1-Flash (764B) on 4×CMP 170HX: PP4 + shadow KV + EXL3 2bpw + DSpark + 512k ctx + native vision — patches, recipes, acceptance…☆15Sep 29, 2026Updated last month
- A tool to unlobotomize your NVIDIA card!☆31Sep 6, 2026Updated 2 months ago
- Unlock tool for the NVIDIA CMP 170HX (GA100) mining card. Restores full A100 compute throughput by exploiting the Falcon BootROM .fwsigna…☆57Jul 30, 2026Updated 3 months ago
- Tuning and qualification harness for the NVIDIA CMP 170HX (GA100). Measures, gates and recovers clock/voltage settings, and treats a comp…☆96Sep 28, 2026Updated last month
- GLM-5.3-Flash on 4× NVIDIA CMP 170HX with vLLM: up to 482.6 tok/s single-user, up to 943.7 tok/s at 8 users, 262K context, TP4 or PP4, on…☆88Oct 26, 2026Updated last week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- CMP 170HX technical wiki: silicon, firmware, the community unlock, procedures and open problems. 55 pages.☆75Aug 22, 2026Updated 2 months ago
- vLLM for NVIDIA CMP 170HX (Ampere sm_80): fast, repeatable model serving on one card or several☆27Updated this week
- DeepSeek-V4.1-Flash on 4× NVIDIA CMP 170HX with vLLM: up to 297 tok/s for one user, up to 868 tok/s at eight, 262K context, one-command c…☆22Updated this week
- Community-tested recipes, diagnostics, and benchmarks for CMP 170HX AI workloads☆96Oct 19, 2026Updated 2 weeks ago
- A cmpunlocker fork with working p2p on SYS-4028GR-TRT2☆27Aug 8, 2026Updated 2 months ago
- A tool to unlobotomize your NVIDIA card!☆834Oct 28, 2026Updated last week
- 170hx-pve-gen2-controller☆11Aug 20, 2026Updated 2 months ago
- Linux P2P unlock and performance fixes for NVIDIA CMP 170HX☆39Sep 22, 2026Updated last month
- NInfer SM80 port for NVIDIA CMP 170HX☆29Aug 22, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The most comprehensive community resource for the NVIDIA CMP 170HX.☆130Jul 30, 2026Updated 3 months ago
- 限制问题区域显存 62906MiB / 65024MiB 支持驱动 610.57.04 ，修改显卡显示名称为NVIDIA Tesla A100☆13Aug 30, 2026Updated 2 months ago
- ☆65Aug 6, 2026Updated 3 months ago
- GPUDirect Storage (GDS) for the NVIDIA CMP 170HX on modern Linux kernels (6.18+). nvidia-fs NVMe registration hooks for the new blk_rq_dm…☆18Aug 19, 2026Updated 2 months ago
- ☆33Jul 25, 2026Updated 3 months ago
- ☆26Oct 20, 2026Updated 2 weeks ago
- Qwen3.8-Flash-Next (W4A16) on 2x CMP 170HX: 110 tok/s decode, 7K prefill, 800 tok/s @ 23 concurrent - runs on 38 GB home RAM, no pinned m…☆20Sep 18, 2026Updated last month
- Qwen3.8-27B INT8 + DFlash2 on a rented CMP 170HX — failure analysis (private GHCR image prevented benchmark)☆17Aug 30, 2026Updated 2 months ago
- 1CatV2 with TileLANG written FA-v100 and many goodies☆20Jul 15, 2026Updated 3 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 解锁自有 NVIDIA CMP 170HX / 90HX 的算力限制。Linux x86-64，需要 root。☆59Aug 6, 2026Updated 3 months ago
- Async PLE SSD offload for Qwen3.8 Flash Next on a 64 GiB SM80 GPU: vLLM patch, setup guide, and measured PP/TG results.☆23Sep 24, 2026Updated last month
- A high-throughput and memory-efficient inference and serving engine for LLMs☆38Updated this week
- 1Cat-vLLM on Intel Gaudi☆46Oct 12, 2026Updated 3 weeks ago
- ☆16Sep 29, 2026Updated last month
- An attempt to use Nvidia CMP cards for Machine Learning.☆33Jun 14, 2026Updated 4 months ago
- ☆28Sep 13, 2026Updated last month
- DGX Spark research and tests - containers, benchmarks, and investigation notes for running models on GB10 (SM 12.1)☆28Oct 29, 2026Updated last week
- forked from vllm-project/flash-attention☆74May 9, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- CMP90HX persistent compute unlock for NVIDIA Open 580.159.03☆19Jul 31, 2026Updated 3 months ago
- Timestep-cache acceleration for MiniMax H3 in ComfyUI — open source, cross-platform, ~3x speedup measured☆19Aug 4, 2026Updated 3 months ago
- FORK of VLLM for AMD MI25/50/60. A high-throughput and memory-efficient inference and serving engine for LLMs☆71May 4, 2025Updated last year
- Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and in…☆18Nov 11, 2024Updated last year
- Validate the usable size of your local LLM cache under pressure☆12Sep 26, 2026Updated last month
- R&G high-performance miner☆24Updated this week
- triton for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆48Dec 8, 2025Updated 10 months ago