Qcompiler / vllm-mixed-precision

Support mixed-precsion inference with vllm
80Updated 2 months ago

Alternatives and similar repositories for vllm-mixed-precision:

Users that are interested in vllm-mixed-precision are comparing it to the libraries listed below