HoyTta0 / KnowledgeDistillation
Knowledge distillation in text classification with pytorch. 知识蒸馏,中文文本分类,教师模型BERT、XLNET,学生模型biLSTM。
☆220Updated 2 years ago
Alternatives and similar repositories for KnowledgeDistillation:
Users that are interested in KnowledgeDistillation are comparing it to the libraries listed below
- 简洁易用版TinyBert:基于Bert进行知识蒸馏的预训练语言模型☆261Updated 4 years ago
- BERT distillation(基于BERT的蒸馏实验 )☆311Updated 4 years ago
- NEZHA: Neural Contextualized Representation for Chinese Language Understanding☆262Updated 3 years ago
- ☆278Updated 2 years ago
- bert pytorch模型微调用于的多标签文本分类☆131Updated 5 years ago
- 天池大赛疫情文本挑战赛线上第三名方案分享☆229Updated 4 years ago
- Chinese NLP Data Augmentation, BERT Contextual Augmentation☆112Updated 2 years ago
- Pytorch进行长文本分类。这里用到的网络有:FastText、TextCNN、TextRNN、TextRCNN、Transformer☆47Updated 4 years ago
- 全局指针统一处理嵌套与非嵌套NER☆253Updated 3 years ago
- 基于pytorch_bert的中文多标签分类☆89Updated 3 years ago
- 对ACL2020 FastBERT论文的复现,论文地址//arxiv.org/pdf/2004.02178.pdf☆193Updated 3 years ago
- 2020 CCF大数据与计算智能大赛-非结构化商业文本信息中隐私信息识别-第7名方案☆73Updated 4 years ago
- NLP句子编码、句子embedding、语义相似度:BERT_avg、BERT_whitening、SBERT、SmiCSE☆176Updated 3 years ago
- 基于Transformers的文本分类☆339Updated 3 years ago
- pytorch中文语言模型预训练☆390Updated 4 years ago
- 微调预训练语言模型,解决多标签分类任务(可加载BERT、Roberta、Bert-wwm以及albert等知名开源tf格式的模型)☆140Updated 4 years ago
- ccf 2020 qa match competition top1☆266Updated 4 years ago
- 文本分类baseline:BERT、半监督学习UDA、对抗学习、数据增强☆101Updated 3 years ago
- SimCSE在中文上的复现,有监督+无监督☆273Updated last month
- experiments of some semantic matching models and comparison of experimental results.☆160Updated last year
- NLP杂货铺,python实现各种算法/工具,辅助算法理解/应用☆154Updated 3 years ago
- A PyTorch-based toolkit for natural language processing☆155Updated 2 years ago
- 从头训练MASK BERT☆136Updated 2 years ago
- Pytorch Bert Finetune in Chinese Text Classification☆217Updated 11 months ago
- multi-label-classification-4-event-type☆133Updated 2 years ago
- NER任务SOTA模型BERT_MRC☆60Updated last year
- chinese-sequence-ner多模型中文命名实体识别☆75Updated 5 years ago
- Code for the ACL2021 paper "Lexicon Enhanced Chinese Sequence Labelling Using BERT Adapter"☆341Updated 3 years ago
- Some Cool NLP and CV Repositories and Solutions (收集NLP中常见任务的开源解决方案、数据集、工具、学习资料等)☆158Updated 4 years ago
- 中文数据集下SimCSE+ESimCSE的实现☆191Updated 2 years ago