HoyTta0 / KnowledgeDistillationLinks
Knowledge distillation in text classification with pytorch. 知识蒸馏,中文文本分类,教师模型BERT、XLNET,学生模型biLSTM。
☆223Updated 2 years ago
Alternatives and similar repositories for KnowledgeDistillation
Users that are interested in KnowledgeDistillation are comparing it to the libraries listed below
Sorting:
- 简洁易用版TinyBert:基于Bert进行知识蒸馏的预训练语言模型☆265Updated 4 years ago
- BERT distillation(基于BERT的蒸馏实验 )☆313Updated 4 years ago
- ☆278Updated 3 years ago
- 基于pytorch_bert的中文多标签分类☆91Updated 3 years ago
- bert pytorch模型微调用于的多标签文本分类☆133Updated 5 years ago
- NEZHA: Neural Contextualized Representation for Chinese Language Understanding☆261Updated 3 years ago
- pytorch中文语言模型预训练☆390Updated 4 years ago
- 对ACL2020 FastBERT论文的复现,论文地址//arxiv.org/pdf/2004.02178.pdf☆194Updated 3 years ago
- 全局指针统一处理嵌套与非嵌套NER☆253Updated 4 years ago
- 基于Transformers的文本分类☆340Updated 3 years ago
- SimCSE在中文上的复现,有监督+无监督☆277Updated 3 months ago
- NLP句子编码、句子embedding、语义相似度:BERT_avg、BERT_whitening、SBERT、SmiCSE☆176Updated 3 years ago
- Chinese NLP Data Augmentation, BERT Contextual Augmentation☆111Updated 3 years ago
- 天池大赛疫情文本挑战赛线上第三名方案分享☆227Updated 4 years ago
- 本项目采用Keras和Keras-bert实现文本多标签分类任务,对BERT进行微调。☆67Updated 4 years ago
- Pytorch Bert Finetune in Chinese Text Classification☆218Updated last year
- 中文数据集下SimCSE+ESimCSE的实现☆192Updated 3 years ago
- 基于Pytorch+BERT+CRF的NLP序列标注模型,目前包括分词,词性标注,命名实体识别等☆60Updated 2 years ago
- experiments of some semantic matching models and comparison of experimental results.☆161Updated last year
- 基于Pytorch的文本分类框架,支持TextCNN、Bert、Electra等。☆62Updated 2 years ago
- 中文无监督SimCSE Pytorch实现☆134Updated 3 years ago
- 微调预训练语言模型,解决多标签分类任务(可加载BERT、Roberta、Bert-wwm以及albert等知名开源tf格式的模型)☆141Updated 4 years ago
- 从头训练MASK BERT☆137Updated 2 years ago
- pytorch implementation of multi-label text classification, includes kinds of models and pretrained. Especially for Chinese preprocessing.☆75Updated 5 years ago
- Source code for the paper "PLOME: Pre-training with Misspelled Knowledge for Chinese Spelling Correction" in ACL2021☆235Updated 2 years ago
- 🙈 An unofficial implementation of SoftMaskedBert based on huggingface/transformers.☆95Updated 4 years ago
- GlobalPointer的优化版/NER实体识别☆120Updated 3 years ago
- 以词为基本单位的中文BERT☆467Updated 3 years ago
- implementation several deep text match (text similarly) models for keras . cdssm, arc-ii,match_pyramid, mvlstm ,esim, drcn ,bimpm, bert, …☆290Updated 4 years ago
- 论文复现《Named Entity Recognition as Dependency Parsing》☆131Updated 4 years ago