microsoft / vattentionLinks

Dynamic Memory Management for Serving LLMs without PagedAttention
396Updated 3 weeks ago

Alternatives and similar repositories for vattention

Users that are interested in vattention are comparing it to the libraries listed below

Sorting: