HoyTta0 / KnowledgeDistillation
Knowledge distillation in text classification with pytorch. 知识蒸馏,中文文本分类,教师模型BERT、XLNET,学生模型biLSTM。
☆213Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for KnowledgeDistillation
- 简洁易用版TinyBert:基于Bert进行知识蒸馏的预训练语言模型☆252Updated 4 years ago
- ☆277Updated 2 years ago
- BERT distillation(基于BERT的蒸馏实验 )☆309Updated 4 years ago
- NEZHA: Neural Contextualized Representation for Chinese Language Understanding☆262Updated 3 years ago
- Chinese NLP Data Augmentation, BERT Contextual Augmentation☆111Updated 2 years ago
- bert pytorch模型微调用于的多标签文本分类☆125Updated 5 years ago
- 2020 CCF大数据与计算智能大赛-非结构化商业文本信息中隐私信息识别-第7名方案☆74Updated 3 years ago
- 中文数据集下SimCSE+ESimCSE的实现☆189Updated 2 years ago
- 天池大赛疫情文本挑战赛线上第三名方案分享☆228Updated 3 years ago
- 基于pytorch_bert的中文多标签分类☆82Updated 2 years ago
- 全局指针统一处理嵌套与非嵌套NER☆250Updated 3 years ago
- 从头训练MASK BERT☆137Updated last year
- A PyTorch-based toolkit for natural language processing☆154Updated last year
- NLP句子编码、句子embedding、 语义相似度:BERT_avg、BERT_whitening、SBERT、SmiCSE☆173Updated 2 years ago
- Pytorch Bert Finetune in Chinese Text Classification☆212Updated 7 months ago
- SimCSE在中文上的复现,有监督+无监督☆266Updated 2 years ago
- 基于Transformers的文本分类☆336Updated 3 years ago
- Use deep models including BiLSTM, ABCNN, ESIM, RE2, BERT, etc. and evaluate on 5 Chinese NLP datasets: LCQMC, BQ Corpus, ChineseSTS, OCN…☆76Updated 2 years ago
- Pattern-Exploiting Training在中文上的简单实验☆170Updated 4 years ago
- experiments of some semantic matching models and comparison of experimental results.☆159Updated last year
- 中文无监督SimCSE Pytorch实现☆132Updated 3 years ago
- NER 任务SOTA模型BERT_MRC☆59Updated 8 months ago
- CoSENT、STS、SentenceBERT☆162Updated last year
- Named Recognition Entity based on BERT and CRF 基于BERT+CRF的中文命名实体识别☆181Updated last year
- pytorch implementation of multi-label text classification, includes kinds of models and pretrained. Especially for Chinese preprocessing.☆72Updated 4 years ago
- GlobalPointer的优化版/NER实体识别☆112Updated 2 years ago
- some baselines for lic2020 (http://lic2020.cipsc.org.cn/)☆218Updated 4 years ago
- 句子匹配模型,包括无监督的SimCSE、ESimCSE、PromptBERT,和有监督的SBERT、CoSENT。☆97Updated 2 years ago
- ccf 2020 qa match competition top1☆267Updated 3 years ago
- ☆87Updated 3 years ago