microsoft / vattentionLinks

Dynamic Memory Management for Serving LLMs without PagedAttention
405Updated 2 months ago

Alternatives and similar repositories for vattention

Users that are interested in vattention are comparing it to the libraries listed below

Sorting: