microsoft / vattentionLinks

Dynamic Memory Management for Serving LLMs without PagedAttention
384Updated this week

Alternatives and similar repositories for vattention

Users that are interested in vattention are comparing it to the libraries listed below

Sorting: