jllllll / GPTQ-for-LLaMa-CUDA

A combination of Oobabooga's fork and the main cuda branch of GPTQ-for-LLaMa in a package format.
22Updated last year

Related projects

Alternatives and complementary repositories for GPTQ-for-LLaMa-CUDA