huangserva / ninfer-v100-tpxView on GitHub
两张 V100 跑 Qwen3.8-27B 到 100 tok/s(186K 上下文):重写 sm70 注意力内核 + 多卡张量并行。Fork of geoffwatts/ninfer-v100.
☆16Sep 28, 2026Updated last month

Alternatives and similar repositories for ninfer-v100-tpx

Users that are interested in ninfer-v100-tpx are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?