intersun / PKD-for-BERT-Model-CompressionLinks
pytorch implementation for Patient Knowledge Distillation for BERT Model Compression
☆203Updated 6 years ago
Alternatives and similar repositories for PKD-for-BERT-Model-Compression
Users that are interested in PKD-for-BERT-Model-Compression are comparing it to the libraries listed below
Sorting:
- ⛵️The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).☆315Updated 2 years ago
- Adversarial Training for Natural Language Understanding☆252Updated 2 years ago
- ☆79Updated 2 years ago
- Code for the RecAdam paper: Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgetting.☆118Updated 4 years ago
- BERT distillation(基于BERT的蒸馏实验 )☆315Updated 5 years ago
- For the code release of our arXiv paper "Revisiting Few-sample BERT Fine-tuning" (https://arxiv.org/abs/2006.05987).☆185Updated 2 years ago
- UDA(Unsupervised Data Augmentation) implemented by pytorch☆278Updated 5 years ago
- 对ACL2020 FastBERT论文的复现,论文地址//arxiv.org/pdf/2004.02178.pdf☆194Updated 3 years ago
- Open source code for ACL 2020 Paper "Dynamic Fusion Network for Multi-Domain End-to-end Task-Oriented Dialog"☆104Updated 3 years ago
- Knowledge Distillation from BERT☆53Updated 6 years ago
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators☆91Updated 4 years ago
- A PyTorch implementation of "Improving BERT Fine-Tuning via Self-Ensemble and Self-Distillation"☆56Updated 5 years ago
- Learning To Compare For Text , Few shot learning in text classification☆42Updated 5 years ago
- [ACL 2020] DeFormer: Decomposing Pre-trained Transformers for Faster Question Answering☆121Updated 2 years ago
- Code for ACL2020 paper: Few-shot Slot Tagging with Collapsed Dependency Transfer and Label-enhanced Task-adaptive Projection Network☆154Updated 3 years ago
- Code for the paper "Are Sixteen Heads Really Better than One?"☆172Updated 5 years ago
- The score code of FastBERT (ACL2020)☆609Updated 3 years ago
- ☆255Updated 3 years ago
- A list of recent papers about Meta / few-shot learning methods applied in NLP areas.☆231Updated 4 years ago
- ☆168Updated 3 years ago
- Code for ACL 2020 paper "Perturbed Masking: Parameter-free Probing for Analyzing and Interpreting BERT"☆105Updated 2 years ago
- ☆202Updated 2 years ago
- Code for the paper "A Deep Reinforced Sequence-to-Set Model for Multi-Label Classification"☆50Updated 5 years ago
- Pytorch implementation of the methods proposed in **Adversarial Training Methods for Semi-Supervised Text Classification** on IMDB datase…☆43Updated 6 years ago
- "Few-shot Text Classification with Distributional Signatures" ICLR 2020☆260Updated 4 years ago
- Visualization for simple attention and Google's multi-head attention.☆68Updated 7 years ago
- ☆25Updated 5 years ago
- TensorFlow implementation of On the Sentence Embeddings from Pre-trained Language Models (EMNLP 2020)☆534Updated 4 years ago
- ☆93Updated 4 years ago
- Pytorch implementation of Bert and Pals: Projected Attention Layers for Efficient Adaptation in Multi-Task Learning (https://arxiv.org/ab…☆84Updated 6 years ago