mzbac / GPTQ-for-LLaMa-APIView on GitHub
Provide a way to use the GPT-QLLama model as an API
44May 20, 2023Updated 2 years ago

Alternatives and similar repositories for GPTQ-for-LLaMa-API

Users that are interested in GPTQ-for-LLaMa-API are comparing it to the libraries listed below

Sorting:

Are these results useful?