Knowledge distillation in text classification with pytorch. 知识蒸馏，中文文本分类，教师模型BERT、XLNET，学生模型biLSTM。
☆229Jul 27, 2022Updated 3 years ago
Alternatives and similar repositories for KnowledgeDistillation
Users that are interested in KnowledgeDistillation are comparing it to the libraries listed below
Sorting:
- BERT distillation（基于BERT的蒸馏实验 ）☆314Jul 30, 2020Updated 5 years ago
- 简洁易用版TinyBert：基于Bert进行知识蒸馏的预训练语言模型☆271Oct 24, 2020Updated 5 years ago
- An Unofficial Implementation for Distilling Task-Specific Knowledge from BERT into Simple Neural Networks☆10Jul 25, 2024Updated last year
- knowledge distillation: 采用知识蒸馏，训练bert后指导textcnn☆19Apr 29, 2021Updated 4 years ago
- 复现论文《Distilling Task-Specific Knowledge from BERT into Simple Neural Networks》☆16Jun 13, 2021Updated 4 years ago
- 使用Few-Shot方法来做文本分类任务，基于THUCNews数据☆10Jun 4, 2020Updated 5 years ago
- bert蒸馏实践，包含BiLSTM蒸馏BERT和TinyBert☆13Apr 23, 2022Updated 3 years ago
- some demos of Knowledge Distillation in NLP☆23Dec 31, 2020Updated 5 years ago
- CNN、BiLSTM、Bert(3layers)对Bert(12layers)模型的蒸馏的keras实现☆29Mar 3, 2020Updated 6 years ago
- Distilling Task-Specific Knowledge from BERT into Simple Neural Networks.☆15Aug 28, 2020Updated 5 years ago
- multi-label，classifier，text classification，多标签文本分类，文本分类，BERT，ALBERT，multi-label-classification，seq2seq，attention，beam search☆32Jun 1, 2022Updated 3 years ago
- The score code of FastBERT (ACL2020)☆609Oct 29, 2021Updated 4 years ago
- bert pytorch模型微调用于的多标签文本分类☆138Nov 8, 2019Updated 6 years ago
- A PyTorch-based knowledge distillation toolkit for natural language processing☆1,696May 8, 2023Updated 2 years ago
- Knowledge Distillation from BERT☆54Jan 7, 2019Updated 7 years ago
- “达观杯”NLP算法挑战赛 竞赛成绩：排名前1%（29/2885）☆16Sep 24, 2018Updated 7 years ago
- pytorch版损失函数，改写自科学空间文章，【通过互信息思想来缓解类别不平衡问题】、【将“softmax+交叉熵”推广到多标签分类问题】☆12Aug 22, 2021Updated 4 years ago
- NLP中文预训练模型泛化能力挑战赛☆42Dec 11, 2020Updated 5 years ago
- 达观算法比赛ner任务，从重新训练bert，到finetune预测。☆75Nov 2, 2022Updated 3 years ago
- 个人基于谷歌开源的BERT编写的文本分类器（基于微调方式），可自由加载NLP领域知名的预训练语言模型BERT、Bert-wwm、Roberta、ALBert以及ERNIE1.0☆167Aug 15, 2020Updated 5 years ago
- Embedding, NMT, Text_Classification, Text_Generation, NER etc.☆568Jun 12, 2023Updated 2 years ago
- pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注等任务,支持t5模型，支持GPT2进行文章续写。☆1,306Jun 18, 2022Updated 3 years ago
- 2021语言与智能技术竞赛：机器阅读理解任务☆30Jun 13, 2021Updated 4 years ago
- An implement of the paper of EDA for Chinese corpus.中文语料的EDA数据增强工具。NLP数据增强。论文阅读笔记。☆1,386May 31, 2022Updated 3 years ago
- 中英文敏感词、语言检测、中外手机/电话归属地/运营商查询、名字推断性别、手机号抽取、身份证抽取、邮箱抽取、中日文人名库、中文缩写库、拆字词典、词汇情感值、停用词、反动词表、暴恐词表、繁简体转换、英文模拟中文发音、汪峰歌词生成器、职业名称词库、同义词库、反义词库、否定词库、汽…☆16May 6, 2020Updated 5 years ago
- 使用rnn,lstm,gru,fasttext,textcnn,dpcnn,rnn-att,lstm-att,兼容huggleface/transformers，以及以transforemrs作为词嵌入模型，后面接入cnn、rnn、attention等等做文本分类。以及各个…☆519Dec 8, 2022Updated 3 years ago
- 基于Pytorch的，中文语义相似度匹配模型（ABCNN、Albert、Bert、BIMPM、DecomposableAttention、DistilBert、ESIM、RE2、Roberta、SiaGRU、XlNet）☆796Mar 22, 2020Updated 5 years ago
- 中文文本分类，TextCNN，TextRNN，FastText，TextRCNN，BiLSTM_Attention，DPCNN，Transformer，基于pytorch，开箱即用。☆5,706Sep 23, 2020Updated 5 years ago
- 文本匹配的相关模型DSSM,ESIM,ABCNN,BIMPM等，数据集为LCQMC官方数据☆470May 8, 2022Updated 3 years ago
- Kashgari 框架的中文文档☆22Sep 11, 2020Updated 5 years ago
- 基于tensorflow的bilstm+crf的命名实体识别☆12Nov 15, 2020Updated 5 years ago
- QAmatch(qa_match)/文本匹配/文本分类/文本embedding/文本聚类/文本检索（bow/ifidf/ngramtf-df/bert/albert/bm25/…/nn/gbdt/xgb/kmeans/dscan/faiss/….）☆933May 1, 2023Updated 2 years ago
- 一键中文数据增强包 ； NLP数据增强、bert数据增强、EDA：pip install nlpcda☆1,879Mar 18, 2025Updated 11 months ago
- 中文长文本分类、短句子分类、多标签分类、两句子相似度（Chinese Text Classification of Keras NLP, multi-label classify, or sentence classify, long or short），字词句向量嵌入层（…☆1,809Jun 17, 2024Updated last year
- 结合BERT+GRU+ATT模型，对自己收集的人物关系数据进行模型训练，用于人物关系抽取。☆325Mar 24, 2023Updated 2 years ago
- 微调预训练语言模型，解决多标签分类任务(可加载BERT、Roberta、Bert-wwm以及albert等知名开源tf格式的模型)☆140Jul 23, 2020Updated 5 years ago
- Entity and Relation Extraction Based on TensorFlow and BERT. 基于TensorFlow和BERT的管道式实体及关系抽取，2019语言与智能技术竞赛信息抽取任务解决方案。Schema based Knowledge …☆1,230Jun 1, 2020Updated 5 years ago
- 中文知识库问答代码，CCKS2019 CKBQA评测第四名解决方案☆478Apr 5, 2021Updated 4 years ago
- CCKS 2020：新冠知识图谱构建与问答评测（四）新冠知识图谱问答评测☆216Nov 27, 2020Updated 5 years ago