ThisisBillhe / ZipCache

[NeurIPS 2024] The official implementation of ZipCache: Accurate and Efficient KV Cache Quantization with Salient Token Identification
11Updated 3 months ago

Related projects

Alternatives and complementary repositories for ZipCache