intersun / PKD-for-BERT-Model-CompressionLinks
pytorch implementation for Patient Knowledge Distillation for BERT Model Compression
☆203Updated 5 years ago
Alternatives and similar repositories for PKD-for-BERT-Model-Compression
Users that are interested in PKD-for-BERT-Model-Compression are comparing it to the libraries listed below
Sorting:
- ⛵️The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).☆315Updated 2 years ago
- Adversarial Training for Natural Language Understanding☆252Updated last year
- ☆79Updated 2 years ago
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators☆91Updated 4 years ago
- For the code release of our arXiv paper "Revisiting Few-sample BERT Fine-tuning" (https://arxiv.org/abs/2006.05987).☆185Updated 2 years ago
- UDA(Unsupervised Data Augmentation) implemented by pytorch☆278Updated 5 years ago
- Code for the RecAdam paper: Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgetting.☆118Updated 4 years ago
- 对ACL2020 FastBERT论文的复现,论文地址//arxiv.org/pdf/2004.02178.pdf☆194Updated 3 years ago
- A PyTorch implementation of "Improving BERT Fine-Tuning via Self-Ensemble and Self-Distillation"☆56Updated 5 years ago
- BERT distillation(基于BERT的蒸馏实验 )☆314Updated 5 years ago
- Code for the paper "Are Sixteen Heads Really Better than One?"☆172Updated 5 years ago
- [ACL 2020] DeFormer: Decomposing Pre-trained Transformers for Faster Question Answering☆121Updated 2 years ago
- Open source code for ACL 2020 Paper "Dynamic Fusion Network for Multi-Domain End-to-end Task-Oriented Dialog"☆104Updated 3 years ago
- Worth-reading papers and related resources on attention mechanism, Transformer and pretrained language model (PLM) such as BERT. 值得一读的注意力…☆131Updated 4 years ago
- ☆253Updated 2 years ago
- ☆168Updated 3 years ago
- Code for ACL2020 paper: Few-shot Slot Tagging with Collapsed Dependency Transfer and Label-enhanced Task-adaptive Projection Network☆154Updated 3 years ago
- ☆50Updated 2 years ago
- ☆93Updated 4 years ago
- Knowledge Distillation from BERT☆53Updated 6 years ago
- Chinese GPT2: pre-training and fine-tuning framework for text generation☆187Updated 4 years ago
- A list of recent papers about Meta / few-shot learning methods applied in NLP areas.☆231Updated 4 years ago
- Learning To Compare For Text , Few shot learning in text classification☆42Updated 5 years ago
- "Few-shot Text Classification with Distributional Signatures" ICLR 2020☆259Updated 4 years ago
- R-Drop方法在中文任务上的简单实验☆91Updated 3 years ago
- The score code of FastBERT (ACL2020)☆606Updated 3 years ago
- ☆15Updated 5 years ago
- Code for the paper "A Deep Reinforced Sequence-to-Set Model for Multi-Label Classification"☆50Updated 5 years ago
- The repo contains the code of the ACL2020 paper `Dice Loss for Data-imbalanced NLP Tasks`☆274Updated 2 years ago
- ☆202Updated 2 years ago