Babyhamsta / KIVView on GitHub
KV cache middleware for 1M context on 12GB VRAM. Uses K vectors as a retrieval index to fetch V on-demand from system RAM. No model modification, no retraining. Drop-in HuggingFace cache replacement.
☆11Apr 23, 2026Updated 6 months ago

Alternatives and similar repositories for KIV

Users that are interested in KIV are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?