oobabooga / GPTQ-for-LLaMaLinks

4 bits quantization of LLaMa using GPTQ
129Updated last year

Alternatives and similar repositories for GPTQ-for-LLaMa

Users that are interested in GPTQ-for-LLaMa are comparing it to the libraries listed below

Sorting: