NInfer SM80 port for NVIDIA CMP 170HX
☆29Aug 22, 2026Updated 2 months ago
Alternatives and similar repositories for ninfer-cmp170hx
Users that are interested in ninfer-cmp170hx are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 双 SM80 / CMP 170HX 的 Qwen3.8-Flash-Next 社区 vLLM：NVIDIA NVFP4、GDS、TEP2、MTP6，支持 1～10 并发，词表与 PCIe 通信优化。中英文部署与可构建源码。☆28Oct 15, 2026Updated 3 weeks ago
- Async PLE SSD offload for Qwen3.8 Flash Next on a 64 GiB SM80 GPU: vLLM patch, setup guide, and measured PP/TG results.☆23Sep 24, 2026Updated last month
- Qwen3.8-Flash-Next (W4A16) on 2x CMP 170HX: 110 tok/s decode, 7K prefill, 800 tok/s @ 23 concurrent - runs on 38 GB home RAM, no pinned m…☆20Sep 18, 2026Updated last month
- A cmpunlocker fork with working p2p on SYS-4028GR-TRT2☆27Aug 8, 2026Updated 3 months ago
- Community-tested recipes, diagnostics, and benchmarks for CMP 170HX AI workloads☆98Updated this week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- DeepSeek-V4-Flash-0731 on 4x CMP 170HX (sm_80): 98 tok/s decode, ~5300 tok/s prefill. DSpark speculative decoding under pipeline parallel…☆118Aug 13, 2026Updated 2 months ago
- A tool to unlobotomize your NVIDIA card!☆31Sep 6, 2026Updated 2 months ago
- ☆16Sep 29, 2026Updated last month
- A tool to unlobotomize your NVIDIA card!☆837Oct 28, 2026Updated 2 weeks ago
- CMP 170HX technical wiki: silicon, firmware, the community unlock, procedures and open problems. 55 pages.☆76Aug 22, 2026Updated 2 months ago
- ☆33Jul 25, 2026Updated 3 months ago
- DeepSeek-V4.1-Flash on 4× NVIDIA CMP 170HX with vLLM: up to 297 tok/s for one user, up to 868 tok/s at eight, 262K context, one-command c…☆25Nov 2, 2026Updated last week
- Tuning and qualification harness for the NVIDIA CMP 170HX (GA100). Measures, gates and recovers clock/voltage settings, and treats a comp…☆97Sep 28, 2026Updated last month
- DeepSeek-V4.1-Flash (764B) on 4×CMP 170HX: PP4 + shadow KV + EXL3 2bpw + DSpark + 512k ctx + native vision — patches, recipes, acceptance…☆15Sep 29, 2026Updated last month
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Native vLLM and ROCm 7.x runtime acceleration for AMD Radeon RX 6000 Series (RDNA2) on Windows 11.☆23Aug 25, 2026Updated 2 months ago
- vLLM 0.33 fork for consumer GPUs: 3 x 262K sessions on 4x RTX 3090, Qwen 3.8 Flash-Next at 207 tok/s, up to 17 on bigger cards. Seven che…☆48Updated this week
- 适配泰安S8030显卡机自动调节系统风扇组件☆13Dec 13, 2024Updated last year
- NVIDIA Linux open GPU with P2P support☆12Aug 2, 2026Updated 3 months ago
- ☆25Aug 12, 2025Updated last year
- 在四卡A100上适配Sglang部署deepseek-v4-flash正式版模型☆14Aug 2, 2026Updated 3 months ago
- Adaptive Flutter widgets that resolve by platform, OS version and form factor — Liquid Glass on iOS 26 and macOS Tahoe, Material 3 Expres…☆11Sep 15, 2026Updated last month
- ☆11Oct 18, 2026Updated 3 weeks ago
- A laptop keyboard reverse-engineering helper☆14Jun 12, 2022Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- The most comprehensive community resource for the NVIDIA CMP 170HX.☆133Jul 30, 2026Updated 3 months ago
- Local LLM speed measurements from a 4x RTX 3090 rig, with exact launch commands and per-run provenance.☆18Aug 15, 2026Updated 2 months ago
- dsv41-flash-pp5-170hx &pp6 Supports the original (full/unquantized) model. Prefill 7,000 t/s, decode 45-75-125 t/s. dspark. Requires 200 …☆13Nov 2, 2026Updated last week
- ☆65Aug 6, 2026Updated 3 months ago
- Not insane. Designed to read WDB files from the latest World of Warcraft builds and output CSV files. Could be used as a library by other…☆15Sep 27, 2025Updated last year
- GPUDirect Storage (GDS) for the NVIDIA CMP 170HX on modern Linux kernels (6.18+). nvidia-fs NVMe registration hooks for the new blk_rq_dm…☆18Aug 19, 2026Updated 2 months ago
- A paperless-ngx configuration to automatically translate documents to your desired languages.☆10Oct 9, 2026Updated last month
- Serve EXL3 (ExLlamaV3 trellis) quantized models on vLLM fork runtimes — any architecture, mixed per-layer bitrates, composable with sourc…☆27Updated this week
- Desktop UI for the NInfer local LLM inference engine☆33Nov 2, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 解锁自有 NVIDIA CMP 170HX / 90HX 的算力限制。Linux x86-64，需要 root。☆62Aug 6, 2026Updated 3 months ago
- Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and in…☆18Nov 11, 2024Updated 2 years ago
- 为 Home Assistant 添加对小米手环 BLE 广播的支持☆12Updated this week
- Docker deployment of Qwen3.8-27B (NVFP4) on a single RTX 5090: Full native 256K-token context (FP8 KV) + MTP working at 120-170 tokens/s,…☆13Sep 5, 2026Updated 2 months ago
- cpp write language detect model☆11Sep 22, 2021Updated 5 years ago
- RemoteKnown (远程知道了) 完全开源 本地终端远程行为感知与审计系统 让用户"清楚知道自己是否、何时、正在被远程控制"，保护隐私安全。☆15Oct 21, 2026Updated 3 weeks ago
- EdgeAI Kit — The missing UI toolkit for on-device LLMs in Flutter. Device checks, model management, recommendations, chat/vision/tool-cal…☆15May 5, 2026Updated 6 months ago
Are these results useful?