mzbac / AutoGPTQ-APILinks

Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.
90Updated last year

Alternatives and similar repositories for AutoGPTQ-API

Users that are interested in AutoGPTQ-API are comparing it to the libraries listed below

Sorting: