Alternatives and similar repositories for transformers_without_tears

Users that are interested in transformers_without_tears are comparing it to the libraries listed below

• layer6ai-labs / T-Fixup
  Code for the ICML'20 paper "Improving Transformer Optimization Through Better Initialization"
  ☆89Updated 4 years ago
• laiguokun / Funnel-Transformer
  ☆219Updated 5 years ago
• clovaai / length-adaptive-transformer
  Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)
  ☆102Updated 4 years ago
• namisan / exdeep-nmt
  ☆32Updated 4 years ago
• harvardnlp / cascaded-generation
  Cascaded Text Generation with Markov Transformers
  ☆129Updated 2 years ago
• ofirpress / sandwich_transformer
  This repository contains the code for running the character-level Sandwich Transformers from our ACL 2020 paper on Improving Transformer …
  ☆55Updated 4 years ago
• bloodwass / mixout
  Implementation of Mixout with PyTorch
  ☆75Updated 2 years ago
• facebookresearch / DisCo
  DisCo Transformer for Non-autoregressive MT
  ☆77Updated 3 years ago
• XuezheMax / fairseq-apollo
  FairSeq repo with Apollo optimizer
  ☆114Updated last year
• UriSha / EmbeddinglessNMT
  The implementation of "Neural Machine Translation without Embeddings", NAACL 2021
  ☆33Updated 4 years ago
• allenai / sledgehammer
  ☆48Updated 5 years ago
• IBM / PoWER-BERT
  Method to improve inference time for BERT. This is an implementation of the paper titled "PoWER-BERT: Accelerating BERT Inference via Pro…
  ☆62Updated 3 weeks ago
• LiyuanLucasLiu / Transformer-Clinic
  Understanding the Difficulty of Training Transformers
  ☆330Updated 3 years ago
• pmichel31415 / are-16-heads-really-better-than-1
  Code for the paper "Are Sixteen Heads Really Better than One?"
  ☆172Updated 5 years ago
• jungokasai / deep-shallow
  ☆44Updated 5 years ago
• dreamgonfly / BERT-pytorch
  PyTorch implementation of BERT in "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding"
  ☆109Updated 6 years ago
• zomux / lanmt
  LaNMT: Latent-variable Non-autoregressive Neural Machine Translation with Deterministic Inference
  ☆79Updated 4 years ago
• lucidrains / charformer-pytorch
  Implementation of the GBST block from the Charformer paper, in Pytorch
  ☆118Updated 4 years ago
• epfml / collaborative-attention
  Code for Multi-Head Attention: Collaborate Instead of Concatenate
  ☆151Updated 2 years ago
• allenai / tpu_pretrain
  LM Pretraining with PyTorch/TPU
  ☆136Updated 5 years ago
• bzhangGo / zero
  Zero -- A neural machine translation system
  ☆153Updated 2 years ago
• uds-lsv / bert-stable-fine-tuning
  On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines
  ☆137Updated 2 years ago
• lancopku / Prime
  A simple module consistently outperforms self-attention and Transformer model on main NMT datasets with SoTA performance.
  ☆85Updated 2 years ago
• EdinburghNLP / opus-100-corpus
  ☆94Updated last year
• VProv / BPE-Dropout
  An official implementation of "BPE-Dropout: Simple and Effective Subword Regularization" algorithm.
  ☆52Updated 4 years ago
• noe / fairseq-tensorboard
  Small utility to monitor fairseq training in tensorboard
  ☆21Updated 6 years ago
• nng555 / ssmba
  ☆62Updated 3 years ago
• serrano-s / attn-tests
  Checking the interpretability of attention on text classification models
  ☆49Updated 6 years ago
• facebookresearch / Mask-Predict
  A masked language modeling objective to train a model to predict any subset of the target words, conditioned on both the input text and a…
  ☆244Updated 4 years ago
• cindyxinyiwang / SDE
  Source code for the paper "Multilingual Neural Machine Translation with Soft Decoupled Encoding"
  ☆29Updated 4 years ago