Don-Chad / ninfer-3090View on GitHub
Hyper optimised Qwen3.8-27B inference on one RTX 3090: ReplaySSM, MTP3, reasoning effort, C1-C8 batching, and native Windows and Linux builds.
378Aug 31, 2026Updated 2 weeks ago

Alternatives and similar repositories for ninfer-3090

Users that are interested in ninfer-3090 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?