yangyifei729 / KVSharer

Source code of paper ''KVSharer: Efficient Inference via Layer-Wise Dissimilar KV Cache Sharing''
16Updated last month

Related projects

Alternatives and complementary repositories for KVSharer