intersun / PKD-for-BERT-Model-CompressionLinks
pytorch implementation for Patient Knowledge Distillation for BERT Model Compression
☆203Updated 5 years ago
Alternatives and similar repositories for PKD-for-BERT-Model-Compression
Users that are interested in PKD-for-BERT-Model-Compression are comparing it to the libraries listed below
Sorting:
- ⛵️The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).☆313Updated 2 years ago
- Adversarial Training for Natural Language Understanding☆251Updated last year
- ☆78Updated 2 years ago
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators☆91Updated 3 years ago
- For the code release of our arXiv paper "Revisiting Few-sample BERT Fine-tuning" (https://arxiv.org/abs/2006.05987).☆184Updated 2 years ago
- Code for the RecAdam paper: Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgetting.☆118Updated 4 years ago
- Code for the paper "Are Sixteen Heads Really Better than One?"☆172Updated 5 years ago
- 对ACL2020 FastBERT论文的复现,论文地址//arxiv.org/pdf/2004.02178.pdf☆193Updated 3 years ago
- A PyTorch implementation of "Improving BERT Fine-Tuning via Self-Ensemble and Self-Distillation"☆56Updated 5 years ago
- BERT distillation(基于BERT的蒸馏实验 )☆313Updated 5 years ago
- UDA(Unsupervised Data Augmentation) implemented by pytorch☆278Updated 5 years ago
- Knowledge Distillation from BERT☆52Updated 6 years ago
- "Few-shot Text Classification with Distributional Signatures" ICLR 2020☆259Updated 4 years ago
- Repository for the paper "Fast and Accurate Deep Bidirectional Language Representations for Unsupervised Learning"☆109Updated 4 years ago
- Code for the paper "A Deep Reinforced Sequence-to-Set Model for Multi-Label Classification"☆50Updated 5 years ago
- Learning To Compare For Text , Few shot learning in text classification☆42Updated 5 years ago
- ☆93Updated 3 years ago
- Worth-reading papers and related resources on attention mechanism, Transformer and pretrained language model (PLM) such as BERT. 值得一读的注意力…☆131Updated 4 years ago
- Visualization for simple attention and Google's multi-head attention.☆67Updated 7 years ago
- Open source code for ACL 2020 Paper "Dynamic Fusion Network for Multi-Domain End-to-end Task-Oriented Dialog"☆104Updated 3 years ago
- This is the official code repository for NumNet+(https://leaderboard.allenai.org/drop/submission/blu418v76glsbnh1qvd0)☆177Updated last year
- ☆251Updated 2 years ago
- ☆50Updated 2 years ago
- [ACL 2020] DeFormer: Decomposing Pre-trained Transformers for Faster Question Answering☆120Updated 2 years ago
- A list of recent papers about Meta / few-shot learning methods applied in NLP areas.☆231Updated 4 years ago
- Code for ACL2020 paper: Few-shot Slot Tagging with Collapsed Dependency Transfer and Label-enhanced Task-adaptive Projection Network☆153Updated 3 years ago
- ☆168Updated 3 years ago
- ☆121Updated 6 years ago
- ☆24Updated 5 years ago
- Research code for ACL 2020 paper: "Distilling Knowledge Learned in BERT for Text Generation".☆131Updated 4 years ago