JT-Ushio / MHA2MLA

Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
149Updated this week

Alternatives and similar repositories for MHA2MLA:

Users that are interested in MHA2MLA are comparing it to the libraries listed below