microsoft / vattention

Dynamic Memory Management for Serving LLMs without PagedAttention
238Updated last week

Related projects

Alternatives and complementary repositories for vattention