dropreg / R-DropLinks
☆879Updated last year
Alternatives and similar repositories for R-Drop
Users that are interested in R-Drop are comparing it to the libraries listed below
Sorting:
- RoFormer V1 & V2 pytorch☆501Updated 3 years ago
- Implementation of some unbalanced loss like focal_loss, dice_loss, DSC Loss, GHM Loss et.al☆264Updated 2 years ago
- Pytorch version of BERT-whitening☆307Updated 3 years ago
- Code for our ACL 2021 paper - ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer☆541Updated 3 years ago
- UDA(Unsupervised Data Augmentation) implemented by pytorch☆277Updated 5 years ago
- The repo contains the code of the ACL2020 paper `Dice Loss for Data-imbalanced NLP Tasks`☆274Updated 2 years ago
- A Pytorch Implementation of "Attention is All You Need" and "Weighted Transformer Network for Machine Translation"☆557Updated 4 years ago
- Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"☆364Updated last year
- The score code of FastBERT (ACL2020)☆605Updated 3 years ago
- A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.☆934Updated 2 years ago
- Rotary Transformer☆970Updated 3 years ago
- Pytorch implementation of Supporting Clustering with Contrastive Learning, NAACL 2021☆303Updated last year
- ☆492Updated last year
- Implementation of paper "Towards a Unified View of Parameter-Efficient Transfer Learning" (ICLR 2022)☆534Updated 3 years ago
- ⛵️The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).☆313Updated 2 years ago
- Pytorch Implementation of Google BERT☆593Updated 5 years ago
- 超轻量级bert的pytorch版本,大量中文注释,容易修改结构,持续更新☆413Updated 3 years ago
- 简单的向量白化改善句向量质量☆483Updated 4 years ago
- list of efficient attention modules☆1,010Updated 3 years ago
- 简洁易用版TinyBert:基于Bert进行知识蒸馏的预训练语言模型☆265Updated 4 years ago
- TensorFlow implementation of On the Sentence Embeddings from Pre-trained Language Models (EMNLP 2020)☆532Updated 4 years ago
- (Linear-chain) Conditional random field in PyTorch.☆963Updated last year
- DeLighT: Very Deep and Light-Weight Transformers☆469Updated 4 years ago
- SimCSE在中文任务上的简单实验☆604Updated last year
- Codes for "TENER: Adapting Transformer Encoder for Named Entity Recognition"☆376Updated 4 years ago
- A Lite Bert For Self-Supervised Learning Language Representations☆717Updated 5 years ago
- [ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723☆728Updated 2 years ago
- Code and source for paper ``How to Fine-Tune BERT for Text Classification?``☆634Updated 3 years ago
- Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve exis…☆251Updated 3 years ago
- A curated list of research papers in Sentence Reprsentation Learning and a sts leaderboard of sentence embeddings.☆316Updated last year