mzbac / GPTQ-for-LLaMa-API

Provide a way to use the GPT-QLLama model as an API
43Updated last year

Related projects

Alternatives and complementary repositories for GPTQ-for-LLaMa-API