sterlind / GPTQ-for-LLaMaLinks

4 bits quantization of LLaMa using GPTQ
12Updated 2 years ago

Alternatives and similar repositories for GPTQ-for-LLaMa

Users that are interested in GPTQ-for-LLaMa are comparing it to the libraries listed below

Sorting: