xiaopp123 / knowledge_distillation
bert蒸馏实践,包含BiLSTM蒸馏BERT和TinyBert
☆11Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for knowledge_distillation
- Knowledge distillation in text classification with pytorch. 知识蒸馏,中文文本分类,教师模型BERT、XLNET,学生模型biLSTM。☆213Updated 2 years ago
- 简洁易用版TinyBert:基于Bert进行知识蒸馏的预训练语言模型☆252Updated 4 years ago
- 基于pytorch_bert的中文多标签分类☆82Updated 2 years ago
- Correcting Chinese Spelling Errors with Phonetic Pre-training 非官方实现☆38Updated 2 years ago
- 超长文本分类(大于1000字);文档级/篇章级文本分类;主要是解决长距离依赖问题☆117Updated 3 years ago
- bilibili-nlp☆26Updated 2 years ago
- SimCSE中文语义相似度对比学习模型☆77Updated 2 years ago
- experiments of some semantic matching models and comparison of experimental results.☆159Updated last year
- Source code for the paper "PLOME: Pre-training with Misspelled Knowledge for Chinese Spelling Correction" in ACL2021☆229Updated 2 years ago
- 基于 pytorch 的 bert 实现和下游任务微调☆47Updated last year
- 基于Pytorch的知识蒸馏(中文文本分类)☆16Updated last year
- 主要介绍了NLP的基础模型以及相关算法☆95Updated 5 years ago
- chinese-sequence-ner多模型中文命名实体识别☆76Updated 4 years ago
- ☆275Updated 2 years ago
- 基于BERT的中文命名实体识别☆30Updated 2 years ago
- BERT distillation(基于BERT的蒸馏实验 )☆309Updated 4 years ago
- 基于ERNIE的中文NER☆31Updated 2 years ago
- bert pytorch模型微调用于的多标签文本分类☆125Updated 5 years ago
- 基于词汇信息融合的中文NER模型☆160Updated 2 years ago
- 基于Bert实现中文文本二分类☆23Updated 4 years ago
- SimCSE有监督与无监督实验复现☆145Updated 8 months ago
- 中文词义消歧项目(Chinese WSD),基于LSTM + ATTENTION模型架构,Pytorch实现。代码简单,上手容易。☆18Updated 2 years ago
- 基于pytorch+bert的中文文本分类☆74Updated last year
- 基于 BERT 模型的中文文本分类工具☆58Updated 2 years ago
- 本项目采用Keras和Keras-bert实现中文序列标注,对BERT进行微调,并在多个命名实体识别数据集上进行测试。☆47Updated 3 years ago
- Implemention of NER model on chinese dataset.☆67Updated last year
- 基于pytorch + bert的多标签文本分类(multi label text classification)☆90Updated last year
- 文本相似度,语义向量,文本向量,text-similarity,similarity, sentence-similarity,BERT,SimCSE,BERT-Whitening,Sentence-BERT, PromCSE, SBERT☆68Updated 6 months ago
- CMeEE/CBLUE/NER实体识别☆123Updated 2 years ago
- 全局指针统一处理嵌套与非嵌套NER的Pytorch实现☆380Updated last year