Qcompiler / MixQ_Tensorrt_LLM

Mixed precision inference by Tensorrt-LLM
78Updated 5 months ago

Alternatives and similar repositories for MixQ_Tensorrt_LLM:

Users that are interested in MixQ_Tensorrt_LLM are comparing it to the libraries listed below