ThisisBillhe / ZipCacheLinks

[NeurIPS 2024] The official implementation of ZipCache: Accurate and Efficient KV Cache Quantization with Salient Token Identification
21Updated 2 months ago

Alternatives and similar repositories for ZipCache

Users that are interested in ZipCache are comparing it to the libraries listed below

Sorting: