mzbac / AutoGPTQ-API

Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.
91Updated last year

Alternatives and similar repositories for AutoGPTQ-API:

Users that are interested in AutoGPTQ-API are comparing it to the libraries listed below