Qcompiler / vllm-mixed-precision

Support mixed-precsion inference with vllm
97Updated 2 weeks ago

Related projects

Alternatives and complementary repositories for vllm-mixed-precision