Alternatives and similar repositories for R-transformer:

Users that are interested in R-transformer are comparing it to the libraries listed below

• andreamad8 / Universal-Transformer-Pytorch
  Implementation of Universal Transformer in Pytorch
  ☆259Updated 6 years ago
• FreedomIntelligence / complex-order
  ☆83Updated 5 years ago
• google-deepmind / lamb
  LAnguage Modelling Benchmarks
  ☆137Updated 4 years ago
• mttk / rnn-classifier
  Minimal RNN classifier with self-attention in Pytorch
  ☆150Updated 3 years ago
• laiguokun / Funnel-Transformer
  ☆218Updated 4 years ago
• yikangshen / Ordered-Neurons
  Code for the paper "Ordered Neurons: Integrating Tree Structures into Recurrent Neural Networks"
  ☆578Updated 5 years ago
• locuslab / trellisnet
  [ICLR'19] Trellis Networks for Sequence Modeling
  ☆472Updated 5 years ago
• tatp22 / linformer-pytorch
  My take on a practical implementation of Linformer for Pytorch.
  ☆413Updated 2 years ago
• AuCson / PyTorch-Batch-Attention-Seq2seq
  PyTorch implementation of batched bi-RNN encoder and attention-decoder.
  ☆279Updated 6 years ago
• lancopku / Prime
  A simple module consistently outperforms self-attention and Transformer model on main NMT datasets with SoTA performance.
  ☆86Updated last year
• keitakurita / Better_LSTM_PyTorch
  An LSTM in PyTorch with best practices (weight dropout, forget bias, etc.) built-in. Fully compatible with PyTorch LSTM.
  ☆133Updated 5 years ago
• seba-1511 / lstms.pth
  PyTorch implementations of LSTM Variants (Dropout + Layer Norm)
  ☆136Updated 3 years ago
• facebookresearch / adaptive-span
  Transformer training code for sequential tasks
  ☆611Updated 3 years ago
• guolinke / TUPE
  Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve exis…
  ☆251Updated 3 years ago
• cerebroai / reformers
  Efficient Transformers for research, PyTorch and Tensorflow using Locality Sensitive Hashing
  ☆94Updated 5 years ago
• CyberZHG / torch-multi-head-attention
  Multi-head attention in PyTorch
  ☆151Updated 6 years ago
• mit-han-lab / lite-transformer
  [ICLR 2020] Lite Transformer with Long-Short Range Attention
  ☆607Updated 9 months ago
• XuezheMax / flowseq
  Generative Flow based Sequence-to-Sequence Toolkit written in Python.
  ☆245Updated 5 years ago
• CyberZHG / keras-multi-head
  A wrapper layer for stacking layers horizontally
  ☆228Updated 3 years ago
• yunjey / seq2seq-dataloader
  PyTorch DataLoader for seq2seq
  ☆85Updated 6 years ago
• andrewpeng02 / transformer-translation
  Using Pytorch's nn.Transformer module to create an english to french neural machine translation model.
  ☆77Updated 4 years ago
• Rick-McCoy / Reformer-pytorch
  Implements Reformer: The Efficient Transformer in pytorch.
  ☆85Updated 5 years ago
• Stonesjtu / Pytorch-NCE
  The Noise Contrastive Estimation for softmax output written in Pytorch
  ☆318Updated 5 years ago
• jayparks / transformer
  A Pytorch Implementation of "Attention is All You Need" and "Weighted Transformer Network for Machine Translation"
  ☆555Updated 4 years ago
• bojone / on-lstm
  Keras implement of ON-LSTM (Ordered Neurons: Integrating Tree Structures into Recurrent Neural Networks)
  ☆156Updated 5 years ago
• nn116003 / self-attention-classification
  document classification using LSTM + self attention
  ☆113Updated 5 years ago
• monk1337 / Various-Attention-mechanisms
  This repository contain various types of attention mechanism like Bahdanau , Soft attention , Additive Attention , Hierarchical Attention…
  ☆125Updated 3 years ago
• zhuohan123 / macaron-net
  Codes for "Understanding and Improving Transformer From a Multi-Particle Dynamic System Point of View"
  ☆148Updated 5 years ago
• tacchinotacchi / distil-bilstm
  Scripts to train a bidirectional LSTM with knowledge distillation from BERT
  ☆158Updated 5 years ago
• leviswind / pytorch-transformer
  pytorch implementation of Attention is all you need
  ☆238Updated 3 years ago