Qcompiler / MixQ_Tensorrt_LLM

Mixed precision inference by Tensorrt-LLM
93Updated 3 weeks ago

Related projects

Alternatives and complementary repositories for MixQ_Tensorrt_LLM