mzbac / GPTQ-for-LLaMa-API

Provide a way to use the GPT-QLLama model as an API
43Updated last year

Alternatives and similar repositories for GPTQ-for-LLaMa-API:

Users that are interested in GPTQ-for-LLaMa-API are comparing it to the libraries listed below