mit-han-lab / lite-transformerLinks
[ICLR 2020] Lite Transformer with Long-Short Range Attention
☆609Updated 11 months ago
Alternatives and similar repositories for lite-transformer
Users that are interested in lite-transformer are comparing it to the libraries listed below
Sorting:
- DeLighT: Very Deep and Light-Weight Transformers☆469Updated 4 years ago
- My take on a practical implementation of Linformer for Pytorch.☆414Updated 2 years ago
- Official PyTorch Repo for "ReZero is All You Need: Fast Convergence at Large Depth"☆408Updated 10 months ago
- [ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing☆335Updated 11 months ago