ChenMnZ / PrefixQuant

An algorithm for weight-activation quantization (W4A4, W4A8) of LLMs, supporting both static and dynamic quantization
118Updated last month

Alternatives and similar repositories for PrefixQuant:

Users that are interested in PrefixQuant are comparing it to the libraries listed below