Alternatives and similar repositories for mixout:

Users that are interested in mixout are comparing it to the libraries listed below

• nng555 / ssmba
  ☆63Updated 2 years ago
• lucidrains / coco-lm-pytorch
  Implementation of COCO-LM, Correcting and Contrasting Text Sequences for Language Model Pretraining, in Pytorch
  ☆45Updated 4 years ago
• ofirpress / sandwich_transformer
  This repository contains the code for running the character-level Sandwich Transformers from our ACL 2020 paper on Improving Transformer …
  ☆55Updated 4 years ago
• facebookresearch / ELECTRA-Fewshot-Learning
  This repository contains the code for paper Prompting ELECTRA Few-Shot Learning with Discriminative Pre-Trained Models.
  ☆47Updated 2 years ago
• clovaai / length-adaptive-transformer
  Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)
  ☆101Updated 4 years ago
• amazon-science / transformers-data-augmentation
  Code associated with the "Data Augmentation using Pre-trained Transformer Models" paper
  ☆52Updated last year
• microsoft / COCO-LM
  [NeurIPS 2021] COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining
  ☆118Updated last year
• naver-ai / MetricMT
  The official code repository for MetricMT - a reward optimization method for NMT with learned metrics
  ☆25Updated 3 years ago
• naver-ai / hypermix
  Code for text augmentation method leveraging large-scale language models
  ☆62Updated 3 years ago
• archinetai / smart-pytorch
  PyTorch – SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models.
  ☆61Updated 2 years ago
• jungokasai / deep-shallow
  ☆43Updated 4 years ago
• facebookresearch / UNLU
  Code for the paper "UnNatural Language Inference" to appear at ACL 2021 (Long Paper)
  ☆36Updated 3 years ago
• lucidrains / distilled-retriever-pytorch
  Implementation of the retriever distillation procedure as outlined in the paper "Distilling Knowledge from Reader to Retriever"
  ☆32Updated 4 years ago
• lucidrains / marge-pytorch
  Implementation of Marge, Pre-training via Paraphrasing, in Pytorch
  ☆75Updated 4 years ago
• shreydesai / calibration
  Code and datasets for the EMNLP 2020 paper "Calibration of Pre-trained Transformers"
  ☆59Updated last year
• qqaatw / pytorch-realm-orqa
  PyTorch reimplementation of REALM and ORQA
  ☆22Updated 3 years ago
• UriSha / EmbeddinglessNMT
  The implementation of "Neural Machine Translation without Embeddings", NAACL 2021
  ☆33Updated 3 years ago
• bigscience-workshop / architecture-objective
  ☆95Updated last year
• vklabmipt / implicit-unlikelihood-training
  Improving Neural Text Generation with Reinforcement Learning
  ☆22Updated 4 years ago
• asappresearch / revisit-bert-finetuning
  For the code release of our arXiv paper "Revisiting Few-sample BERT Fine-tuning" (https://arxiv.org/abs/2006.05987).
  ☆183Updated last year
• namisan / exdeep-nmt
  ☆32Updated 3 years ago
• clovaai / minimal-rnr-qa
  [NAACL 2021] Designing a Minimal Retrieve-and-Read System for Open-Domain Question Answering
  ☆36Updated 3 years ago
• facebookresearch / DisCo
  DisCo Transformer for Non-autoregressive MT
  ☆78Updated 2 years ago
• fallcat / stupidNMT
  Hard-Coded Gaussian Attention for Neural Machine Translation
  ☆36Updated last year
• allenai / sledgehammer
  ☆47Updated 4 years ago
• yxuansu / TaCL
  [NAACL'22] TaCL: Improving BERT Pre-training with Token-aware Contrastive Learning
  ☆93Updated 2 years ago
• cambridgeltl / mirror-bert
  [EMNLP'21] Mirror-BERT: Converting Pretrained Language Models to universal text encoders without labels.
  ☆79Updated 2 years ago
• cindyxinyiwang / multiview-subword-regularization
  PyTorch implementation of NAACL 2021 paper "Multi-view Subword Regularization"
  ☆24Updated 3 years ago
• sebastianruder / emnlp2021-multiqa-tutorial
  EMNLP 2021 Tutorial: Multi-Domain Multilingual Question Answering
  ☆38Updated 3 years ago
• gorokoba560 / norm-analysis-of-transformer
  ☆83Updated 11 months ago