wejoncy / QLLM

A general 2-8 bits quantization toolbox with GPTQ/AWQ/HQQ, and export to onnx/onnx-runtime easily.
149Updated last month

Related projects

Alternatives and complementary repositories for QLLM