DunZhang / KnowledgeDistillationLinks
A general framework for knowledge distillation
☆54Updated 4 years ago
Alternatives and similar repositories for KnowledgeDistillation
Users that are interested in KnowledgeDistillation are comparing it to the libraries listed below
Sorting:
- pytorch implementation for Patient Knowledge Distillation for BERT Model Compression☆203Updated 5 years ago
- Adversarial Training for NLP in Keras☆46Updated 5 years ago
- Distilling Task-Specific Knowledge from BERT into Simple Neural Networks.☆14Updated 5 years ago
- R-Drop方法在中文任务上的简单实验☆91Updated 3 years ago
- A PyTorch implementation of "Improving BERT Fine-Tuning via Self-Ensemble and Self-Distillation"☆56Updated 5 years ago
- Official implementation of AAAI-21 paper "Label Confusion Learning to Enhance Text Classification Models"☆118Updated 2 years ago
- ☆15Updated 5 years ago
- Code for AAAI2021 paper: Few-Shot Learning for Multi-label Intent Detection.☆109Updated 3 years ago
- NLP中文预训练模型泛化能力挑战赛☆43Updated 4 years ago
- Knowledge Distillation from BERT☆53Updated 6 years ago
- Knowledge distillation in text classification with pytorch. 知识蒸馏,中文文本分类,教师模型BERT、XLNET,学生模型biLSTM。☆226Updated 3 years ago
- 对ACL2020 FastBERT论文的复现,论文地址//arxiv.org/pdf/2004.02178.pdf☆194Updated 3 years ago
- BERT distillation(基于BERT的蒸馏实验 )☆314Updated 5 years ago
- 天池人工智能创新赛3-ch12hu团队周星星分享☆27Updated 4 years ago
- Learning To Compare For Text , Few shot learning in text classification☆42Updated 5 years ago
- ☆41Updated 3 years ago
- 第一名克莱登大学二队方案分享☆18Updated 4 years ago
- pytorch版simcse无监督语义相似模型☆23Updated 4 years ago
- a simple pytorch implement of Multi-Sample Dropout☆57Updated 6 years ago
- Codes for "Learning Sparse Sharing Architectures for Multiple Tasks"☆95Updated 4 years ago
- Exploring mixup strategies for text classification☆31Updated 4 years ago
- 简洁易用版TinyBert:基于Bert进行知识蒸馏的预训练语言模型☆266Updated 4 years ago
- UDA(Unsupervised Data Augmentation) implemented by pytorch☆278Updated 5 years ago
- NLP中文预训练模型泛化能力挑战赛(https://tianchi.aliyun.com/competition/entrance/531841/introduction?spm=5176.12281957.1004.2.7a883eafYhYhOq)☆37Updated 4 years ago
- 全球人工智能技术创新大赛-赛道三:小布助手对话短文本语义匹配☆38Updated 4 years ago
- A PyTorch-based toolkit for natural language processing☆159Updated 2 years ago
- tensorflow version of bert-of-theseus☆63Updated 4 years ago
- Worth-reading papers and related resources on attention mechanism, Transformer and pretrained language model (PLM) such as BERT. 值得一读的注意力…☆131Updated 4 years ago
- 基于 Tensorflow,仿 Scikit-Learn 设计的深度学习自然语言处理框架。支持 40 余种模型类,涵盖语言模型、文本分类、NER、MRC、知识蒸馏等各个领域☆117Updated 2 years ago
- classical model code implementation of few-shot/one-shot lenaring, including siamese network, prototypical network, relation network, ind…☆138Updated 5 years ago