Lisennlp / TinyBertLinks
简洁易用版TinyBert:基于Bert进行知识蒸馏的预训练语言模型
☆270Updated 5 years ago
Alternatives and similar repositories for TinyBert
Users that are interested in TinyBert are comparing it to the libraries listed below
Sorting:
- pytorch中文语言模型预训练☆386Updated 5 years ago
- BERT distillation(基于BERT的蒸馏实验 )☆314Updated 5 years ago
- Knowledge distillation in text classification with pytorch. 知识蒸馏,中文文本分类,教师模型BERT 、XLNET,学生模型biLSTM。☆229Updated 3 years ago
- NEZHA: Neural Contextualized Representation for Chinese Language Understanding☆260Updated 4 years ago
- 以词为基本单位的中文BERT☆473Updated 4 years ago
- 真 · “Deep Learning for Humans”☆141Updated 4 years ago
- Source code for the paper "PLOME: Pre-training with Misspelled Knowledge for Chinese Spelling Correction" in ACL2021☆240Updated 3 years ago
- 对ACL2020 FastBERT 论文的复现,论文地址//arxiv.org/pdf/2004.02178.pdf☆193Updated 4 years ago
- Pattern-Exploiting Training在中文上的简单实验☆173Updated 5 years ago
- CoSENT、STS、SentenceBERT☆171Updated 11 months ago
- 简单的向量白化改善句向量质量☆487Updated 4 years ago
- Pytorch Bert Finetune in Chinese Text Classification☆222Updated last year
- Code for the ACL2021 paper "Lexicon Enhanced Chinese Sequence Labelling Using BERT Adapter"☆345Updated 4 years ago
- experiments of some semantic matching models and comparison of experimental results.☆163Updated 2 months ago
- SimBERT升级版(SimBERTv2)!☆445Updated 3 years ago
- 全局指针统一处理嵌套与非嵌套NER☆259Updated 4 years ago
- 从头训练MASK BERT☆140Updated 3 years ago
- ☆442Updated 3 years ago
- 中文NLP数据集☆158Updated 6 years ago
- 中文自然语言推理数据集(A large-scale Chinese Nature language inference and Semantic similarity calculation Dataset)☆436Updated 5 years ago
- Modify Chinese text, modified on LaserTagger Model. 文本复述,基于lasertagger做中文文本数据增强。☆322Updated 2 years ago
- ☆273Updated last year
- ☆278Updated 3 years ago
- RoFormer升级版☆154Updated 3 years ago
- 🙈 An unofficial implementation of SoftMaskedBert based on huggingface/transformers.☆97Updated 4 years ago
- 全球人工智能技术创新大赛-赛道三-冠军方案☆239Updated 4 years ago
- Unilm for Chinese Chitchat Robot.基于Unilm模型的夸夸式闲聊机器人项目。☆158Updated 5 years ago
- 中文无监督SimCSE Pytorch实现☆135Updated 4 years ago
- FewCLUE 小样本学习测评基准,中文版☆518Updated 3 years ago
- SimCSE在中文上的复现,有监督+无监督☆280Updated 11 months ago