Alternatives and similar repositories for R-transformer

Users that are interested in R-transformer are comparing it to the libraries listed below

• mttk / rnn-classifier
  Minimal RNN classifier with self-attention in Pytorch
  ☆152Updated 4 years ago
• keitakurita / Better_LSTM_PyTorch
  An LSTM in PyTorch with best practices (weight dropout, forget bias, etc.) built-in. Fully compatible with PyTorch LSTM.
  ☆134Updated 6 years ago
• google-deepmind / lamb
  LAnguage Modelling Benchmarks
  ☆138Updated 5 years ago
• andreamad8 / Universal-Transformer-Pytorch
  Implementation of Universal Transformer in Pytorch
  ☆265Updated 7 years ago
• seba-1511 / lstms.pth
  PyTorch implementations of LSTM Variants (Dropout + Layer Norm)
  ☆137Updated 4 years ago
• laiguokun / Funnel-Transformer
  ☆220Updated 5 years ago
• FreedomIntelligence / complex-order
  ☆84Updated 6 years ago
• Stonesjtu / Pytorch-NCE
  The Noise Contrastive Estimation for softmax output written in Pytorch
  ☆319Updated 6 years ago
• monk1337 / Various-Attention-mechanisms
  This repository contain various types of attention mechanism like Bahdanau , Soft attention , Additive Attention , Hierarchical Attention…
  ☆127Updated 4 years ago
• b-etienne / Seq2seq-PyTorch
  ☆76Updated 5 years ago
• yunjey / seq2seq-dataloader
  PyTorch DataLoader for seq2seq
  ☆85Updated 6 years ago
• cerebroai / reformers
  Efficient Transformers for research, PyTorch and Tensorflow using Locality Sensitive Hashing
  ☆95Updated 5 years ago
• locuslab / trellisnet
  [ICLR'19] Trellis Networks for Sequence Modeling
  ☆473Updated 6 years ago
• XuezheMax / flowseq
  Generative Flow based Sequence-to-Sequence Toolkit written in Python.
  ☆246Updated 5 years ago
• Rick-McCoy / Reformer-pytorch
  Implements Reformer: The Efficient Transformer in pytorch.
  ☆86Updated 5 years ago
• tatp22 / linformer-pytorch
  My take on a practical implementation of Linformer for Pytorch.
  ☆422Updated 3 years ago
• gitabcworld / skiprnn_pytorch
  A pytorch implementation of the paper: "Skip RNN: Learning to Skip State Updates in Recurrent Neural Networks"
  ☆83Updated 7 years ago
• nadavbh12 / Character-Level-Language-Modeling-with-Deeper-Self-Attention-pytorch
  Reproducing Character-Level-Language-Modeling with Deeper Self-Attention in PyTorch
  ☆62Updated 7 years ago
• bastings / annotated_encoder_decoder
  The Annotated Encoder Decoder with Attention
  ☆167Updated 4 years ago
• kaushalshetty / Positional-Encoding
  Encoding position with the word embeddings.
  ☆84Updated 7 years ago
• graykode / ALBERT-Pytorch
  Pytorch Implementation of ALBERT(A Lite BERT for Self-supervised Learning of Language Representations)
  ☆228Updated 4 years ago
• AuCson / PyTorch-Batch-Attention-Seq2seq
  PyTorch implementation of batched bi-RNN encoder and attention-decoder.
  ☆281Updated 7 years ago
• DevSinghSachan / ssl_text_classification
  Semi Supervised Learning for Text-Classification
  ☆83Updated 6 years ago
• baaesh / DiSAN-pytorch
  DiSAN: Directional Self-Attention Network for RNN/CNN-Free Language Understanding
  ☆26Updated 7 years ago
• guolinke / TUPE
  Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve exis…
  ☆253Updated 4 years ago
• leimao / Two-Layer-Hierarchical-Softmax-PyTorch
  Two-Layer Hierarchical Softmax Implementation for PyTorch
  ☆71Updated 5 years ago
• CyberZHG / keras-layer-normalization
  Layer normalization implemented in Keras
  ☆60Updated 3 years ago
• facebookresearch / adaptive-span
  Transformer training code for sequential tasks
  ☆610Updated 4 years ago
• tacchinotacchi / distil-bilstm
  Scripts to train a bidirectional LSTM with knowledge distillation from BERT
  ☆159Updated 6 years ago
• Orkis-Research / Quaternion-Recurrent-Neural-Networks
  This is the code for the paper 'Quaternion Recurrent Neural Networks'.
  ☆61Updated 7 years ago