tunz / transformer-pytorch
Transformer implementation in PyTorch.
☆466Updated 5 years ago
Related projects ⓘ
Alternatives and complementary repositories for transformer-pytorch
- A Pytorch Implementation of "Attention is All You Need" and "Weighted Transformer Network for Machine Translation"☆549Updated 4 years ago
- Transformer: PyTorch Implementation of "Attention Is All You Need"☆3,062Updated 3 months ago
- Transformer seq2seq model, program that can build a language translator from parallel corpus☆1,350Updated last year
- An implementation of Performer, a linear attention-based transformer, in Pytorch☆1,098Updated 2 years ago
- Transformer based on a variant of attention that is linear complexity in respect to sequence length☆700Updated 6 months ago
- ☆870Updated 6 months ago
- This is a repository with the code for the ACL 2019 paper "Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, t…☆303Updated 3 years ago
- Reformer, the efficient Transformer, in Pytorch☆2,125Updated last year
- PyTorch implementation of some attentions for Deep Learning Researchers.☆516Updated 2 years ago
- Pytorch library for fast transformer implementations☆1,644Updated last year
- Multi-head attention in PyTorch☆148Updated 5 years ago
- An All-MLP solution for Vision, from Google AI☆1,004Updated 2 months ago
- My take on a practical implementation of Linformer for Pytorch.☆408Updated 2 years ago
- Implement the paper "Self-Attention with Relative Position Representations"☆124Updated 3 years ago
- Pytorch Implementation of Google BERT☆592Updated 4 years ago
- DeLighT: Very Deep and Light-Weight Transformers☆467Updated 4 years ago
- Natural Language Processing Tutorial for Deep Learning Researchers☆1,078Updated 2 years ago
- Fully featured implementation of Routing Transformer☆284Updated 3 years ago
- PyTorch Re-Implementation of "Generating Sentences from a Continuous Space" by Bowman et al 2015 https://arxiv.org/abs/1511.06349☆587Updated 3 months ago
- Implementation of gMLP, an all-MLP replacement for Transformers, in Pytorch☆425Updated 3 years ago
- An annotated implementation of the Transformer paper.☆5,740Updated 7 months ago
- A PyTorch Tutorials of Sentiment Analysis Classification (RNN, LSTM, Bi-LSTM, LSTM+Attention, CNN)☆291Updated last year
- list of efficient attention modules☆990Updated 3 years ago
- Longformer: The Long-Document Transformer☆2,048Updated last year
- Implementation of Linformer for Pytorch☆257Updated 10 months ago
- PyTorch implementation of beam search decoding for seq2seq models☆336Updated last year
- A PyTorch implementation of the Transformer model in "Attention is All You Need".☆8,883Updated 7 months ago
- Minimal Seq2Seq model with Attention for Neural Machine Translation in PyTorch☆691Updated 3 years ago
- An implementation of local windowed attention for language modeling☆386Updated 2 months ago
- Implementation of VAE and CVAE using Pytorch on MNIST dataset☆82Updated 3 years ago