Alternatives and similar repositories for R-Drop:

Users that are interested in R-Drop are comparing it to the libraries listed below

• JunnYu / RoFormer_pytorch
  RoFormer V1 & V2 pytorch
  ☆482Updated 2 years ago
• SanghunYun / UDA_pytorch
  UDA(Unsupervised Data Augmentation) implemented by pytorch
  ☆275Updated 5 years ago
• yym6472 / ConSERT
  Code for our ACL 2021 paper - ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer
  ☆539Updated 3 years ago
• autoliuweijie / BERT-whitening-pytorch
  Pytorch version of BERT-whitening
  ☆309Updated 3 years ago
• ZhuiyiTechnology / roformer
  Rotary Transformer
  ☆858Updated 2 years ago
• autoliuweijie / FastBERT
  The score code of FastBERT (ACL2020)
  ☆605Updated 3 years ago
• xinyi-code / NLP-Loss-Pytorch
  Implementation of some unbalanced loss like focal_loss, dice_loss, DSC Loss, GHM Loss et.al
  ☆253Updated last year
• bohanli / BERT-flow
  TensorFlow implementation of On the Sentence Embeddings from Pre-trained Language Models (EMNLP 2020)
  ☆530Updated 3 years ago
• google-research / adapter-bert
  ☆484Updated last year
• ShannonAI / dice_loss_for_NLP
  The repo contains the code of the ACL2020 paper `Dice Loss for Data-imbalanced NLP Tasks`
  ☆274Updated last year
• lucidrains / FLASH-pytorch
  Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"
  ☆357Updated last year
• jxhe / unify-parameter-efficient-tuning
  Implementation of paper "Towards a Unified View of Parameter-Efficient Transfer Learning" (ICLR 2022)
  ☆520Updated 2 years ago
• mit-han-lab / lite-transformer
  [ICLR 2020] Lite Transformer with Long-Short Range Attention
  ☆602Updated 6 months ago
• yxuansu / SimCTG
  [NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation
  ☆468Updated 10 months ago
• bojone / BERT-whitening
  简单的向量白化改善句向量质量
  ☆481Updated 3 years ago
• amazon-science / sccl
  Pytorch implementation of Supporting Clustering with Contrastive Learning, NAACL 2021
  ☆297Updated last year
• THUDM / P-tuning
  A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.
  ☆928Updated 2 years ago
• JetRunner / BERT-of-Theseus
  ⛵️The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).
  ☆311Updated last year
• princeton-nlp / SimCSE
  [EMNLP 2021] SimCSE: Simple Contrastive Learning of Sentence Embeddings https://arxiv.org/abs/2104.08821
  ☆3,482Updated 3 months ago
• princeton-nlp / LM-BFF
  [ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723
  ☆722Updated 2 years ago
• Doragd / Awesome-Sentence-Embedding
  A curated list of research papers in Sentence Reprsentation Learning and a sts leaderboard of sentence embeddings.
  ☆310Updated last year
• ContrastiveSR / Contrastive_Learning_Papers
  A list of contrastive Learning papers
  ☆302Updated 2 years ago
• yitu-opensource / ConvBert
  ☆250Updated 2 years ago
• Separius / awesome-fast-attention
  list of efficient attention modules
  ☆995Updated 3 years ago
• intersun / PKD-for-BERT-Model-Compression
  pytorch implementation for Patient Knowledge Distillation for BERT Model Compression
  ☆200Updated 5 years ago
• zr2021 / 2021_QQ_AIAC_Tack1_1st
  QQ浏览器2021AI算法大赛赛道一 第1名 方案
  ☆264Updated 2 years ago
• sacmehta / delight
  DeLighT: Very Deep and Light-Weight Transformers
  ☆468Updated 4 years ago
• SALT-NLP / MixText
  MixText: Linguistically-Informed Interpolation of Hidden Space for Semi-Supervised Text Classification
  ☆353Updated 4 years ago
• XiangLi1999 / PrefixTuning
  Prefix-Tuning: Optimizing Continuous Prompts for Generation
  ☆905Updated 8 months ago
• bojone / SimCSE
  SimCSE在中文任务上的简单实验
  ☆596Updated last year