mit-han-lab / llm-awq

[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
2,687Updated 2 weeks ago

Alternatives and similar repositories for llm-awq:

Users that are interested in llm-awq are comparing it to the libraries listed below