microsoft / vattentionView on GitHub
Dynamic Memory Management for Serving LLMs without PagedAttention
480May 30, 2025Updated 11 months ago

Alternatives and similar repositories for vattention

Users that are interested in vattention are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?