qiangsiwei / bert_distill
BERT distillation(基于BERT的蒸馏实验 )
☆310Updated 4 years ago
Alternatives and similar repositories for bert_distill:
Users that are interested in bert_distill are comparing it to the libraries listed below
- 对ACL2020 FastBERT论文的复现,论文地址//arxiv.org/pdf/2004.02178.pdf☆192Updated 3 years ago
- NEZHA: Neural Contextualized Representation for Chinese Language Understanding☆262Updated 3 years ago
- Pytorch Bert Finetune in Chinese Text Classification☆213Updated 9 months ago
- ☆279Updated 4 years ago
- ccf 2020 qa match competition top1☆266Updated 3 years ago
- implementation several deep text match (text similarly) models for keras . cdssm, arc-ii,match_pyramid, mvlstm ,esim, drcn ,bimpm, bert, …☆291Updated 4 years ago
- 简洁易用版TinyBert:基于Bert进行知识蒸馏的预训练语言模型☆254Updated 4 years ago
- transform multi-label classification as sentence pair task, with more training data and information☆179Updated 5 years ago
- pytorch中文语言模型预训练☆389Updated 4 years ago
- TensorFlow code and pre-trained models for BERT and ERNIE☆144Updated 5 years ago
- 以词为基本单位的中文BERT☆463Updated 3 years ago
- Chinese NLP Data Augmentation, BERT Contextual Augmentation☆112Updated 2 years ago
- Pattern-Exploiting Training在中文上的简单实验☆170Updated 4 years ago
- 中文预训练XLNet模型: Pre-Trained Chinese XLNet_Large☆230Updated 5 years ago
- ☆438Updated 2 years ago
- 简单的向量白化改善句向量质量☆481Updated 3 years ago
- 中文NLP数据集☆153Updated 5 years ago
- 从头训练MASK BERT☆137Updated 2 years ago
- 天池大赛疫情文本挑战赛线上第三名方案分享☆228Updated 3 years ago
- Modify Chinese text, modified on LaserTagger Model. 文本复述,基于lasertagger做中文文本数据增强。☆318Updated last year
- 将百度ernie的paddlepaddle模型转成tensorflow模型☆177Updated 5 years ago
- using bilstm-crf,bert and other methods to do sequence tagging task☆414Updated last year
- 整理一下在keras中使用T5模型的要点☆172Updated 2 years ago
- Chinese Language Generation Evaluation 中文生成任务基准测评☆246Updated 4 years ago
- 文本匹配的相关模型DSSM,ESIM,ABCNN,BIMPM等,数据集为LCQMC官方数据☆468Updated 2 years ago
- 科赛网-莱斯杯:全国第二届“军事智能机器阅读”挑战赛 前十团队PPT文档代码总结☆130Updated 4 years ago
- chinese bertsum ; bertsum 抽取式模型中文版本;给出案例数据、全代码注释;下载即可训练、预测、学习☆204Updated last year
- Data Augmentation for NLP. NLP数据增强☆295Updated 4 years ago
- ☆277Updated 2 years ago
- Knowledge distillation in text classification with pytorch. 知识蒸馏,中文文本分类,教师模型BERT、XLNET,学生模型biLSTM。☆215Updated 2 years ago