vllm-project / llm-compressor

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
1,162Updated this week

Alternatives and similar repositories for llm-compressor:

Users that are interested in llm-compressor are comparing it to the libraries listed below