Doraemonzzz / nanoTransNormerLinks
☆11Updated last year
Alternatives and similar repositories for nanoTransNormer
Users that are interested in nanoTransNormer are comparing it to the libraries listed below
Sorting:
- Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)☆24Updated last year
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆27Updated last year