microsoft / vattention

Dynamic Memory Management for Serving LLMs without PagedAttention
222Updated this week

Related projects

Alternatives and complementary repositories for vattention