vllm-project / llm-compressorLinks

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
1,441Updated this week

Alternatives and similar repositories for llm-compressor

Users that are interested in llm-compressor are comparing it to the libraries listed below

Sorting: