SystemPanic / vllm-windows

A high-throughput and memory-efficient inference and serving engine for LLMs (Windows build & kernels)
18Updated last week

Alternatives and similar repositories for vllm-windows:

Users that are interested in vllm-windows are comparing it to the libraries listed below