LuLuLuyi / LongHeads

LongHeads: Multi-Head Attention is Secretly a Long Context Processor
29Updated last year

Alternatives and similar repositories for LongHeads:

Users that are interested in LongHeads are comparing it to the libraries listed below