Lisennlp / TinyBert
简洁易用版TinyBert:基于Bert进行知识蒸馏的预训练语言模型
☆252Updated 4 years ago
Related projects ⓘ
Alternatives and complementary repositories for TinyBert
- NEZHA: Neural Contextualized Representation for Chinese Language Understanding☆262Updated 3 years ago
- BERT distillation(基于BERT的蒸馏实验 )☆309Updated 4 years ago
- ☆277Updated 2 years ago
- pytorch中文语言模型预训练☆389Updated 4 years ago
- Source code for the paper "PLOME: Pre-training with Misspelled Knowledge for Chinese Spelling Correction" in ACL2021☆230Updated 2 years ago
- ☆258Updated 3 months ago
- CoSENT、STS、SentenceBERT☆162Updated last year
- Pattern-Exploiting Training在中文上的简单实验☆170Updated 4 years ago
- SimCSE在中文上的复现,有监督+无监督☆266Updated 2 years ago
- experiments of some semantic matching models and comparison of experimental results.☆159Updated last year
- FewCLUE 小样本学习测评基准,中文版☆495Updated 2 years ago
- Knowledge distillation in text classification with pytorch. 知识蒸馏,中文文本分类,教师模型BERT、XLNET,学生模型biLSTM。☆213Updated 2 years ago
- 全局指针统一处理嵌套与非嵌套NER☆250Updated 3 years ago
- SimCSE在中文任务上的简单实验☆591Updated last year
- 真 · “Deep Learning for Humans”☆140Updated 2 years ago
- 以词为基本单位的中文BERT☆458Updated 3 years ago
- Pytorch Bert Finetune in Chinese Text Classification☆212Updated 7 months ago
- Chinese NLP Data Augmentation, BERT Contextual Augmentation☆111Updated 2 years ago
- SimBERT升级版(SimBERTv2)!☆438Updated 2 years ago
- A PyTorch-based toolkit for natural language processing☆154Updated last year
- 简单的向量白化改善句向量质量☆481Updated 3 years ago
- 中文数据集下SimCSE+ESimCSE的实现☆189Updated 2 years ago
- Code for ACL 2021 paper "ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information"☆542Updated last year
- SimCSE有监督与无监督实验复现☆145Updated 8 months ago
- NLP句子编码、句子embedding、语义相似度:BERT_avg、BERT_whitening、SBERT、SmiCSE☆173Updated 2 years ago
- 全球人工智能技术创新大赛-赛道三-冠军方案☆235Updated 3 years ago
- Code for the ACL2021 paper "Lexicon Enhanced Chinese Sequence Labelling Using BERT Adapter"☆341Updated 2 years ago
- 中文NLP数据集☆151Updated 5 years ago
- 中文自然语言推理数据集(A large-scale Chinese Nature language inference and Semantic similarity calculation Dataset)☆425Updated 4 years ago
- 中文无监督SimCSE Pytorch实现☆132Updated 3 years ago