Alternatives and similar repositories for R-Drop

Users that are interested in R-Drop are comparing it to the libraries listed below

• JunnYu / RoFormer_pytorch
  RoFormer V1 & V2 pytorch
  ☆519Updated 3 years ago
• SanghunYun / UDA_pytorch
  UDA(Unsupervised Data Augmentation) implemented by pytorch
  ☆278Updated 6 years ago
• yym6472 / ConSERT
  Code for our ACL 2021 paper - ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer
  ☆542Updated 4 years ago
• xinyi-code / NLP-Loss-Pytorch
  Implementation of some unbalanced loss like focal_loss, dice_loss, DSC Loss, GHM Loss et.al
  ☆268Updated 2 years ago
• autoliuweijie / BERT-whitening-pytorch
  Pytorch version of BERT-whitening
  ☆311Updated 4 years ago
• amazon-science / sccl
  Pytorch implementation of Supporting Clustering with Contrastive Learning, NAACL 2021
  ☆305Updated 2 years ago
• bojone / BERT-whitening
  简单的向量白化改善句向量质量
  ☆486Updated 4 years ago
• autoliuweijie / FastBERT
  The score code of FastBERT (ACL2020)
  ☆609Updated 4 years ago
• bohanli / BERT-flow
  TensorFlow implementation of On the Sentence Embeddings from Pre-trained Language Models (EMNLP 2020)
  ☆535Updated 4 years ago
• ZhuiyiTechnology / roformer
  Rotary Transformer
  ☆1,077Updated 3 years ago
• THUDM / P-tuning
  A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.
  ☆938Updated 3 years ago
• jxhe / unify-parameter-efficient-tuning
  Implementation of paper "Towards a Unified View of Parameter-Efficient Transfer Learning" (ICLR 2022)
  ☆542Updated 3 years ago
• ShannonAI / dice_loss_for_NLP
  The repo contains the code of the ACL2020 paper `Dice Loss for Data-imbalanced NLP Tasks`
  ☆275Updated 2 years ago
• JetRunner / BERT-of-Theseus
  ⛵️The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).
  ☆315Updated 2 years ago
• evelinehong / Transformer_Relative_Position_PyTorch
  Implement the paper "Self-Attention with Relative Position Representations"
  ☆139Updated 5 years ago
• bojone / SimCSE
  SimCSE在中文任务上的简单实验
  ☆605Updated 2 years ago
• zr2021 / 2021_QQ_AIAC_Tack1_1st
  QQ浏览器2021AI算法大赛赛道一 第1名 方案
  ☆267Updated 3 years ago
• kongds / Prompt-BERT
  PromptBERT: Improving BERT Sentence Embeddings with Prompts
  ☆342Updated 2 years ago
• Doragd / Awesome-Sentence-Embedding
  A curated list of research papers in Sentence Reprsentation Learning and a sts leaderboard of sentence embeddings.
  ☆314Updated 2 years ago
• princeton-nlp / LM-BFF
  [ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723
  ☆731Updated 3 years ago
• yitu-opensource / ConvBert
  ☆254Updated 3 years ago
• Meelfy / pytorch_pretrained_BERT
  ☆204Updated 3 years ago
• Link-Li / Balanced-DataParallel
  这里是改进了pytorch的DataParallel, 用来平衡第一个GPU的显存使用量
  ☆231Updated 5 years ago
• lonePatient / albert_pytorch
  A Lite Bert For Self-Supervised Learning Language Representations
  ☆715Updated 5 years ago
• google-research / adapter-bert
  ☆502Updated 2 years ago
• MuQiuJun-AI / bert4pytorch
  超轻量级bert的pytorch版本，大量中文注释，容易修改结构，持续更新
  ☆415Updated 3 years ago
• Lisennlp / TinyBert
  简洁易用版TinyBert：基于Bert进行知识蒸馏的预训练语言模型
  ☆270Updated 5 years ago
• fastnlp / CPT
  CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation
  ☆495Updated 3 years ago
• airaria / TextBrewer
  A PyTorch-based knowledge distillation toolkit for natural language processing
  ☆1,695Updated 2 years ago
• jayparks / transformer
  A Pytorch Implementation of "Attention is All You Need" and "Weighted Transformer Network for Machine Translation"
  ☆575Updated 5 years ago