Skip to content
JimmyMax / ninfer-v100View on GitHub
Single-GPU Tesla V100-32GB (sm_70) inference line: native nvfp4/fp8 and GGUF-derived artifacts, v2 and v3 containers, 27K-token prefill 1.00k tok/s, decode 78+ tok/s.
☆16Nov 19, 2026Updated this week

Alternatives and similar repositories for ninfer-v100

Users that are interested in ninfer-v100 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?