HoyTta0 / KnowledgeDistillation
Knowledge distillation in text classification with pytorch. 知识蒸馏,中文文本分类,教师模型BERT、XLNET,学生模型biLSTM。
☆223Updated 2 years ago
Alternatives and similar repositories for KnowledgeDistillation:
Users that are interested in KnowledgeDistillation are comparing it to the libraries listed below
- 简洁易用版TinyBert:基于Bert进行知识蒸馏的预训练语言模型☆264Updated 4 years ago
- BERT distillation(基于BERT的蒸馏实验 )☆312Updated 4 years ago
- NEZHA: Neural Contextualized Representation for Chinese Language Understanding☆262Updated 3 years ago
- ☆278Updated 3 years ago
- bert pytorch模型微调用于的多标签文本分类☆133Updated 5 years ago
- 存放知乎,博客发表文章中的代码☆47Updated 3 years ago
- 天池大赛疫情文本挑战赛线上第三名方案分享☆228Updated 4 years ago
- Chinese NLP Data Augmentation, BERT Contextual Augmentation☆111Updated 3 years ago
- NLP文本增强的两种方式:同义词替换(利用word2vec词表)和回译☆76Updated 4 years ago
- 本项目采用Keras和Keras-bert实现文本多标签分类任务,对BERT进行微调。☆67Updated 4 years ago
- 基于pytorch_bert的中文多标签分类☆91Updated 3 years ago
- NER任务SOTA模型BERT_MRC☆61Updated last year
- Pytorch Bert Finetune in Chinese Text Classification☆218Updated last year
- 中文数据集下SimCSE+ESimCSE的实现☆192Updated 2 years ago
- 对ACL2020 FastBERT论文的复现,论文地址//arxiv.org/pdf/2004.02178.pdf☆193Updated 3 years ago
- 基于Transformers的文本分类☆339Updated 3 years ago
- pytorch中文语言模型预训练☆389Updated 4 years ago
- chinese-sequence-ner多模型中文命名实体识别☆75Updated 5 years ago
- 使用pytorch搭建textCNN实现中文文本分类☆127Updated 6 years ago
- 中文无监督SimCSE Pytorch实现☆134Updated 3 years ago
- 文本分类baseline:BERT、半监督学习UDA、对抗学习、数据增强☆102Updated 4 years ago
- 利用huggingface实现文本分类☆58Updated 3 years ago
- NLP句子编码、句子embedding、语义相似度:BERT_avg、BERT_whitening、SBERT、SmiCSE☆176Updated 3 years ago
- 全局指针统一处理嵌套与非嵌套NER☆253Updated 4 years ago
- ☆87Updated 3 years ago
- ccf 2020 qa match competition top1☆266Updated 4 years ago
- 基于Pytorch+BERT+CRF的NLP序列标注模型,目前包括分词,词性标注,命名实体识别等☆60Updated 2 years ago
- 基于pytorch + bert的多标签文本分类(multi label text classification)☆103Updated last year
- 超长文本分类(大于1000字);文档级/篇章级文本分类;主要是解决长距离依赖问题☆130Updated 3 years ago
- 主要介绍了NLP的基础模型以及相关算法☆98Updated 5 years ago