weicj / vLLM-2080Ti-DefinitiveView on GitHub
The definitive vLLM runtime for dual RTX 2080 Ti 22GB + NVLink, delivering Qwen 27B local inference with 100+ tok/s single-request decode with support of FP8 weight
358Jul 5, 2026Updated this week

Alternatives and similar repositories for vLLM-2080Ti-Definitive

Users that are interested in vLLM-2080Ti-Definitive are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?