Alternatives and similar repositories for BERT-pytorch

Users that are interested in BERT-pytorch are comparing it to the libraries listed below

• dreamgonfly / transformer-pytorch
  A PyTorch implementation of Transformer in "Attention is All You Need"
  ☆106Updated 4 years ago
• mawentao277 / CharBERT
  CharBERT: Character-aware Pre-trained Language Model (COLING2020)
  ☆121Updated 4 years ago
• bloodwass / mixout
  Implementation of Mixout with PyTorch
  ☆75Updated 2 years ago
• asappresearch / revisit-bert-finetuning
  For the code release of our arXiv paper "Revisiting Few-sample BERT Fine-tuning" (https://arxiv.org/abs/2006.05987).
  ☆184Updated 2 years ago
• pmichel31415 / are-16-heads-really-better-than-1
  Code for the paper "Are Sixteen Heads Really Better than One?"
  ☆172Updated 5 years ago
• Alibaba-NLP / MultilangStructureKD
  [ACL 2020] Structure-Level Knowledge Distillation For Multilingual Sequence Labeling
  ☆71Updated 2 years ago
• ShannonAI / Self_Explaining_Structures_Improve_NLP_Models
  ☆82Updated 4 years ago
• JetRunner / PABEE
  Code for the paper "BERT Loses Patience: Fast and Robust Inference with Early Exit".
  ☆65Updated 4 years ago
• microsoft / COCO-LM
  [NeurIPS 2021] COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining
  ☆117Updated last year
• yxuansu / NAG-BERT
  [EACL'21] Non-Autoregressive with Pretrained Language Model
  ☆62Updated 2 years ago
• shijie-wu / crosslingual-nlp
  This repo supports various cross-lingual transfer learning & multilingual NLP models.
  ☆92Updated last year
• uds-lsv / bert-stable-fine-tuning
  On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines
  ☆136Updated last year
• lonePatient / electra_pytorch
  ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
  ☆91Updated 3 years ago
• yg211 / summary-reward-no-reference
  A reference-free metric for measuring summary quality, learned from human ratings.
  ☆43Updated 2 years ago
• Sanyuan-Chen / RecAdam
  Code for the RecAdam paper: Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgetting.
  ☆117Updated 4 years ago
• oriram / splinter
  ☆92Updated 3 years ago
• fuzihaofzh / repetition-problem-nlg
  Code for the paper "A Theoretical Analysis of the Repetition Problem in Text Generation" in AAAI 2021.
  ☆54Updated 2 years ago
• IBM / PoWER-BERT
  Method to improve inference time for BERT. This is an implementation of the paper titled "PoWER-BERT: Accelerating BERT Inference via Pro…
  ☆61Updated last month
• archinetai / smart-pytorch
  PyTorch – SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models.
  ☆62Updated 2 years ago
• sebastianruder / emnlp2021-multiqa-tutorial
  EMNLP 2021 Tutorial: Multi-Domain Multilingual Question Answering
  ☆38Updated 3 years ago
• amazon-science / transformers-data-augmentation
  Code associated with the "Data Augmentation using Pre-trained Transformer Models" paper
  ☆52Updated 2 years ago
• ethanjperez / true_few_shot
  Code for the paper "True Few-Shot Learning in Language Models" (https://arxiv.org/abs/2105.11447)
  ☆144Updated 3 years ago
• yxuansu / TaCL
  [NAACL'22] TaCL: Improving BERT Pre-training with Token-aware Contrastive Learning
  ☆93Updated 3 years ago
• ChenRocks / Distill-BERT-Textgen
  Research code for ACL 2020 paper: "Distilling Knowledge Learned in BERT for Text Generation".
  ☆131Updated 3 years ago
• yanzhangnlp / IS-BERT
  An Unsupervised Sentence Embedding Method by Mutual Information Maximization (EMNLP2020)
  ☆61Updated 4 years ago
• clovaai / length-adaptive-transformer
  Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)
  ☆101Updated 4 years ago
• ahmetgunduz / pytorch-nlp-project-template
  A Light and Modular PyTorch NLP Project Template
  ☆59Updated 4 years ago
• tanyuqian / ctc-gen-eval
  EMNLP 2021 - CTC: A Unified Framework for Evaluating Natural Language Generation
  ☆97Updated 2 years ago
• CZWin32768 / XNLG
  AAAI-20 paper: Cross-Lingual Natural Language Generation via Pre-Training
  ☆129Updated 3 years ago
• cambridgeltl / mirror-bert
  [EMNLP'21] Mirror-BERT: Converting Pretrained Language Models to universal text encoders without labels.
  ☆79Updated 2 years ago