TheBloke / AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
37Updated last year

Alternatives and similar repositories for AutoGPTQ:

Users that are interested in AutoGPTQ are comparing it to the libraries listed below