mzbac / AutoGPTQ-API

Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.
91Updated last year

Related projects

Alternatives and complementary repositories for AutoGPTQ-API