Implementing SYNTHESIZER: Rethinking Self-Attention in Transformer Models using Pytorch
☆71May 28, 2020Updated 6 years ago
Alternatives and similar repositories for Synthesizer-Rethinking-Self-Attention-Transformer-Models
Users that are interested in Synthesizer-Rethinking-Self-Attention-Transformer-Models are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A PyTorch implementation of the paper - "Synthesizer: Rethinking Self-Attention in Transformer Models"☆75Dec 8, 2022Updated 3 years ago
- Bag of MLP☆20May 31, 2021Updated 5 years ago
- Implementing Pyramid Scene Parsing Network (PSPNet) paper using Pytorch☆16Sep 1, 2020Updated 5 years ago
- Various test models in WNNX format. It can view with `pip install wnetron && wnetron`☆12Jun 22, 2022Updated 4 years ago
- (ACL-IJCNLP 2021) Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models.