dsv41-flash-pp5-170hx &pp6 Supports the original (full/unquantized) model. Prefill 7,000 t/s, decode 45-75-125 t/s. dspark. Requires 200 GB of memory. Supports 1M context.
☆13Nov 2, 2026Updated this week
Alternatives and similar repositories for dsv41-flash-pp5-170hx
Users that are interested in dsv41-flash-pp5-170hx are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Qwen3.8-Flash-Next (W4A16) on 2x CMP 170HX: 110 tok/s decode, 7K prefill, 800 tok/s @ 23 concurrent - runs on 38 GB home RAM, no pinned m…☆20Sep 18, 2026Updated last month
- 限制问题区域显存 62906MiB / 65024MiB 支持驱动 610.57.04 ，修改显卡显示名称为NVIDIA Tesla A100☆13Aug 30, 2026Updated 2 months ago
- DeepSeek-V4.1-Flash (764B) on 4×CMP 170HX: PP4 + shadow KV + EXL3 2bpw + DSpark + 512k ctx + native vision — patches, recipes, acceptance…☆15Sep 29, 2026Updated last month
- DeepSeek-V4.1-Flash on 4× NVIDIA CMP 170HX with vLLM: up to 297 tok/s for one user, up to 868 tok/s at eight, 262K context, one-command c…☆23Updated this week
- ☆26Oct 20, 2026Updated 2 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- glm-5.2 on too many 64 / 80 GB A100's☆22Sep 9, 2026Updated last month
- Async PLE SSD offload for Qwen3.8 Flash Next on a 64 GiB SM80 GPU: vLLM patch, setup guide, and measured PP/TG results.☆23Sep 24, 2026Updated last month
- vLLM for NVIDIA CMP 170HX (Ampere sm_80): fast, repeatable model serving on one card or several☆27Updated this week
- Qwen3.8-27B INT8 + DFlash2 on a rented CMP 170HX — failure analysis (private GHCR image prevented benchmark)☆17Aug 30, 2026Updated 2 months ago
- 双 SM80 / CMP 170HX 的 Qwen3.8-Flash-Next 社区 vLLM：NVIDIA NVFP4、GDS、TEP2、MTP6，支持 1～10 并发，词表与 PCIe 通信优化。中英文部署与可构建源码。☆28Oct 15, 2026Updated 3 weeks ago
- DeepSeek-V4-Flash-0731 on 4x CMP 170HX (sm_80): 98 tok/s decode, ~5300 tok/s prefill. DSpark speculative decoding under pipeline parallel…☆118Aug 13, 2026Updated 2 months ago
- A Pytorch Extention for CMP 170HX☆17Jun 29, 2026Updated 4 months ago
- Linux P2P unlock and performance fixes for NVIDIA CMP 170HX☆39Sep 22, 2026Updated last month
- finetune the chain model based on cvte open source model without traing any GMM for frame alignment☆12Aug 6, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Unlock tool for the NVIDIA CMP 170HX (GA100) mining card. Restores full A100 compute throughput by exploiting the Falcon BootROM .fwsigna…☆57Jul 30, 2026Updated 3 months ago
- Community-tested recipes, diagnostics, and benchmarks for CMP 170HX AI workloads☆97Oct 19, 2026Updated 2 weeks ago
- Single-card Intel Gaudi2 vLLM source snapshot: FP8 Qwen, non-greedy DFlash2/MTP, GDN kernels and host-side optimizations.☆18Updated this week
- 适配泰安S8030显卡机自动调节系统风扇组件☆13Dec 13, 2024Updated last year
- The original as far as I could find.☆14Feb 10, 2025Updated last year
- openthos based on android-x86☆10Mar 27, 2020Updated 6 years ago
- Run Qwen3 Omni - A multimodal AI assistant demo☆72Oct 16, 2025Updated last year
- Active4j-jsp是基于SpingBoot2.0轻量级的java快速开发框架。以Spring Framework为核心容器，Spring MVC为模型视图控制器，Mybatis Plus为数据访问层， Apache Shiro为权限授权层, Redis为分布式缓存，Q…☆15Feb 11, 2026Updated 8 months ago
- ☆14Aug 1, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- GLM-5.3-Flash on 4× NVIDIA CMP 170HX with vLLM: up to 482.6 tok/s single-user, up to 943.7 tok/s at 8 users, 262K context, TP4 or PP4, on…☆89Oct 26, 2026Updated last week
- DSH 消息编辑插件：编辑已发送的消息并从该处分叉对话，气泡下方带版本计数与树状视图。Edit a sent message and branch from that point — version counter, tree view, placement presets…☆30Updated this week
- Tuning and qualification harness for the NVIDIA CMP 170HX (GA100). Measures, gates and recovers clock/voltage settings, and treats a comp…☆96Sep 28, 2026Updated last month
- Flash Attention v2 for Pascal (P100, GTX 1080) and Volta (V100) GPUs — bringing O(N) memory attention to hardware the official flash-attn…☆30Updated this week
- sharedownload☆12Aug 14, 2020Updated 6 years ago
- forked from vllm-project/flash-attention☆74May 9, 2026Updated 5 months ago
- A curated list of awesome AI tools for generating and manipulating 3D models using text, images, or AI-enhanced modeling engines.☆13Apr 19, 2025Updated last year
- PKUAutoElective 服务器容器部署☆12Feb 23, 2024Updated 2 years ago
- ☆15Sep 9, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- HX 家族多功能工具箱：NVIDIA CMP 全系矿卡（30HX/40HX/50HX/70HX/90HX/170HX）工作台——固件解锁、型号伪装、双卡调度、动态省电、快照回滚。单文件免安装，前端与工具包全部内嵌。☆41Oct 25, 2026Updated 2 weeks ago
- Enable more than 64 cores in WSL 2 with this one neat trick.☆14Apr 9, 2024Updated 2 years ago
- MCP server for file operations on non-UTF-8 text: detects the encoding from the bytes, hands the model UTF-8, and writes back in the orig…☆30Oct 31, 2026Updated last week
- This repository is a modified version of lerobot, specifically adapted for the Adora robot.☆13May 12, 2025Updated last year
- different kinds of media for various files☆12Nov 25, 2023Updated 2 years ago
- Add changes so that hostapd works on intel Wi-Fi cards☆14Aug 4, 2025Updated last year
- API developed for Realman Robot (http://www.realman-robotics.com/)☆12Dec 26, 2024Updated last year