claCase / Attention-as-RNN

Non-official implementation of "Attention as an RNN" from https://arxiv.org/pdf/2405.13956, efficient associative parallel prefix scan and recurrent version implemented.
25Updated 8 months ago

Alternatives and similar repositories for Attention-as-RNN:

Users that are interested in Attention-as-RNN are comparing it to the libraries listed below