tunz / transformer-pytorchLinks
Transformer implementation in PyTorch.
☆491Updated 6 years ago
Alternatives and similar repositories for transformer-pytorch
Users that are interested in transformer-pytorch are comparing it to the libraries listed below
Sorting:
- A Pytorch Implementation of "Attention is All You Need" and "Weighted Transformer Network for Machine Translation"☆561Updated 4 years ago
- My take on a practical implementation of Linformer for Pytorch.☆417Updated 3 years ago
- Transformer seq2seq model, program that can build a language translator from parallel corpus☆1,403Updated 2 years ago
- PyTorch implementation of some attentions for Deep Learning Researchers.☆536Updated 3 years ago
- Reformer, the efficient Transformer, in Pytorch☆2,177Updated 2 years ago
- An implementation of Performer, a linear attention-based transformer, in Pytorch☆1,147Updated 3 years ago
- Implement the paper "Self-Attention with Relative Position Representations"☆138Updated 4 years ago
- Pytorch library for fast transformer implementations☆1,727Updated 2 years ago
- An All-MLP solution for Vision, from Google AI☆1,036Updated last month
- ☆882Updated last year
- Multi-head attention in PyTorch☆153Updated 6 years ago
- LSTM and GRU in PyTorch☆262Updated 6 years ago
- Pytorch Implementation of Google BERT☆595Updated 5 years ago
- list of efficient attention modules☆1,012Updated 4 years ago
- Implementation of gMLP, an all-MLP replacement for Transformers, in Pytorch☆428Updated 4 years ago
- [ICLR 2020] Lite Transformer with Long-Short Range Attention☆611Updated last year
- A pytorch &keras implementation and demo of Fastformer.☆189Updated 2 years ago
- Longformer: The Long-Document Transformer☆2,160Updated 2 years ago
- A PyTorch Tutorials of Sentiment Analysis Classification (RNN, LSTM, Bi-LSTM, LSTM+Attention, CNN)☆323Updated 2 years ago
- Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms☆259Updated 4 years ago
- PyTorch implementation of beam search decoding for seq2seq models☆339Updated 2 years ago
- Pytorch implementation of R-Transformer. Some parts of the code are adapted from the implementation of TCN and Transformer.☆230Updated 6 years ago
- Minimal Seq2Seq model with Attention for Neural Machine Translation in PyTorch☆703Updated 4 years ago
- ☆500Updated last year
- PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538☆1,159Updated last year
- Pytorch nn.Transformer Demo☆52Updated 5 years ago
- Transformers for Longer Sequences☆617Updated 3 years ago
- Source code for "On the Relationship between Self-Attention and Convolutional Layers"☆1,109Updated 2 years ago
- Implementation of Transformer encoder in PyTorch☆67Updated 5 years ago
- Implementation of Transformer Model in Tensorflow☆473Updated 2 years ago