bytedance / ABQ-LLM

An acceleration library that supports arbitrary bit-width combinatorial quantization operations
214Updated 4 months ago

Alternatives and similar repositories for ABQ-LLM:

Users that are interested in ABQ-LLM are comparing it to the libraries listed below