DSE-MSU / R-transformerLinks
Pytorch implementation of R-Transformer. Some parts of the code are adapted from the implementation of TCN and Transformer.
☆230Updated 5 years ago
Alternatives and similar repositories for R-transformer
Users that are interested in R-transformer are comparing it to the libraries listed below
Sorting:
- My take on a practical implementation of Linformer for Pytorch.☆414Updated 2 years ago
- ☆218Updated 5 years ago
- LAnguage Modelling Benchmarks☆137Updated 5 years ago
- Implementation of Universal Transformer in Pytorch☆260Updated 6 years ago
- ☆83Updated 5 years ago
- [ICLR'19] Trellis Networks for Sequence Modeling☆472Updated 5 years ago
- Minimal RNN classifier with self-attention in Pytorch☆150Updated 3 years ago
- Generative Flow based Sequence-to-Sequence Toolkit written in Python.☆245Updated 5 years ago
- An LSTM in PyTorch with best practices (weight dropout, forget bias, etc.) built-in. Fully compatible with PyTorch LSTM.☆133Updated 5 years ago
- Code for the paper "Ordered Neurons: Integrating Tree Structures into Recurrent Neural Networks"☆580Updated 5 years ago
- This repository contain various types of attention mechanism like Bahdanau , Soft attention , Additive Attention , Hierarchical Attention…☆126Updated 3 years ago
- PyTorch implementation of batched bi-RNN encoder and attention-decoder.☆280Updated 6 years ago
- Pytorch Implementation of ALBERT(A Lite BERT for Self-supervised Learning of Language Representations)☆226Updated 4 years ago
- A simple module consistently outperforms self-attention and Transformer model on main NMT datasets with SoTA performance.☆85Updated last year
- The Noise Contrastive Estimation for softmax output written in Pytorch☆319Updated 5 years ago
- Transformer training code for sequential tasks☆612Updated 3 years ago
- A wrapper layer for stacking layers horizontally☆228Updated 3 years ago
- Fully featured implementation of Routing Transformer☆295Updated 3 years ago
- A pytorch implementation of Fairseq Convolutional Sequence to Sequence Learning(Gehring et al. 2017)☆46Updated 6 years ago
- pytorch implementation of Attention is all you need☆238Updated 4 years ago
- Efficient Transformers for research, PyTorch and Tensorflow using Locality Sensitive Hashing☆95Updated 5 years ago
- Implements Reformer: The Efficient Transformer in pytorch.☆85Updated 5 years ago
- ☆76Updated 5 years ago
- Keras implement of ON-LSTM (Ordered Neurons: Integrating Tree Structures into Recurrent Neural Networks)☆156Updated 5 years ago
- Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve exis…☆251Updated 3 years ago
- A Structured Self-attentive Sentence Embedding☆492Updated 5 years ago
- The Annotated Encoder Decoder with Attention☆166Updated 4 years ago
- A quick walk-through of the innards of LSTMs and a naive implementation of the Mogrifier LSTM paper in PyTorch☆77Updated 4 years ago
- Easy to use NLP library built on PyTorch and TorchText☆254Updated 5 years ago
- Implementation of the paper Tree Transformer☆214Updated 5 years ago