intersun / PKD-for-BERT-Model-CompressionLinks
pytorch implementation for Patient Knowledge Distillation for BERT Model Compression
☆201Updated 5 years ago
Alternatives and similar repositories for PKD-for-BERT-Model-Compression
Users that are interested in PKD-for-BERT-Model-Compression are comparing it to the libraries listed below
Sorting:
- ⛵️The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).☆313Updated 2 years ago
- Adversarial Training for Natural Language Understanding☆252Updated last year
- For the code release of our arXiv paper "Revisiting Few-sample BERT Fine-tuning" (https://arxiv.org/abs/2006.05987).☆184Updated 2 years ago
- BERT distillation(基于BERT的蒸馏实验 )☆313Updated 4 years ago
- Code for the RecAdam paper: Recall and Learn: Fine-tuning Deep Pretrained Language Models with Less Forgetting.☆117Updated 4 years ago
- ☆78Updated 2 years ago
- Code for the paper "Are Sixteen Heads Really Better than One?"☆172Updated 5 years ago
- 对ACL2020 FastBERT论文的复现,论文地址//arxiv.org/pdf/2004.02178.pdf☆194Updated 3 years ago
- bert annotation, input and output for people from scratch, 代码注释, 有每一步的输入和输出, 适合初学者☆93Updated 2 years ago
- ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators☆91Updated 3 years ago
- ☆121Updated 6 years ago
- UDA(Unsupervised Data Augmentation) implemented by pytorch☆277Updated 5 years ago
- ☆50Updated 2 years ago
- A list of recent papers about Meta / few-shot learning methods applied in NLP areas.☆231Updated 4 years ago
- R-Drop方法在中文任务上的简单实验☆91Updated 3 years ago
- Minghao Hu's thesis on Machine Reading Comprehension☆37Updated 5 years ago
- A PyTorch implementation of "Improving BERT Fine-Tuning via Self-Ensemble and Self-Distillation"☆56Updated 5 years ago
- Learning To Compare For Text , Few shot learning in text classification☆42Updated 5 years ago
- ☆24Updated 5 years ago
- ☆201Updated 2 years ago
- The score code of FastBERT (ACL2020)☆605Updated 3 years ago
- Open source code for ACL 2020 Paper "Dynamic Fusion Network for Multi-Domain End-to-end Task-Oriented Dialog"☆104Updated 3 years ago
- Worth-reading papers and related resources on attention mechanism, Transformer and pretrained language model (PLM) such as BERT. 值得一读的注意力…☆133Updated 4 years ago
- ☆251Updated 2 years ago
- Knowledge Distillation from BERT☆52Updated 6 years ago
- An unofficial implementation of Poly-encoder (Poly-encoders: Transformer Architectures and Pre-training Strategies for Fast and Accurate …☆249Updated 2 years ago
- Code for ACL2020 paper: Few-shot Slot Tagging with Collapsed Dependency Transfer and Label-enhanced Task-adaptive Projection Network☆153Updated 3 years ago
- Leaderboards, Datasets and Papers for Multi-Turn Response Selection in Retrieval-Based Chatbots☆203Updated 4 years ago
- Collections of Chinese reading comprehension datasets☆217Updated 5 years ago
- ☆62Updated 5 years ago