Knowledge distillation in text classification with pytorch. 知识蒸馏，中文文本分类，教师模型BERT、XLNET，学生模型biLSTM。
☆230Jul 27, 2022Updated 3 years ago
Alternatives and similar repositories for KnowledgeDistillation
Users that are interested in KnowledgeDistillation are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- BERT distillation（基于BERT的蒸馏实验 ）☆316Jul 30, 2020Updated 5 years ago
- bert蒸馏实践，包含BiLSTM蒸馏BERT和TinyBert☆13Apr 23, 2022Updated 4 years ago
- 简洁易用版TinyBert：基于Bert进行知识蒸馏的预训练语言模型☆272Oct 24, 2020Updated 5 years ago
- knowledge distillation: 采用知识蒸馏，训练bert后指导textcnn☆19Apr 29, 2021Updated 5 years ago
- 基于Pytorch的知识蒸馏（中文文本分类）☆22Jan 12, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 复现论文《Distilling Task-Specific Knowledge from BERT into Simple Neural Networks》☆16Jun 13, 2021Updated 4 years ago
- Distilling Task-Specific Knowledge from BERT into Simple Neural Networks.☆15Aug 28, 2020Updated 5 years ago
- 使用Few-Shot方法来做文本分类任务，基于THUCNews数据☆10Jun 4, 2020Updated 5 years ago
- some demos of Knowledge Distillation in NLP☆23Dec 31, 2020Updated 5 years ago
- CNN、BiLSTM、Bert(3layers)对Bert(12layers)模型的蒸馏的keras实现☆29Mar 3, 2020Updated 6 years ago
- Knowledge Distillation from BERT☆54Jan 7, 2019Updated 7 years ago
- A PyTorch-based knowledge distillation toolkit for natural language processing☆1,697May 8, 2023Updated 2 years ago
- The score code of FastBERT (ACL2020)☆608Oct 29, 2021Updated 4 years ago
- multi-label，classifier，text classification，多标签文本分类，文本分类，BERT，ALBERT，multi-label-classification，seq2seq，attention，beam search☆32Jun 1, 2022Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- bert pytorch模型微调用于的多标签文本分类☆136Nov 8, 2019Updated 6 years ago
- Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。☆2,662May 30, 2023Updated 2 years ago
- pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注等任务,支持t5模型，支持GPT2进行文章续写。☆1,307Jun 18, 2022Updated 3 years ago
- 个人基于谷歌开源的BERT编写的文本分类器（基于微调方式），可自由加载NLP领域知名的预训练语言模型BERT、Bert-wwm、Roberta、ALBert以及ERNIE1.0☆167Aug 15, 2020Updated 5 years ago
- 达观算法比赛ner任务，从重新训练bert，到finetune预测。☆75Nov 2, 2022Updated 3 years ago
- “达观杯”NLP算法挑战赛 竞赛成绩：排名前1%（29/2885）☆16Sep 24, 2018Updated 7 years ago
- 中英文敏感词、语言检测、中外手机/电话归属地/运营商查询、名字推断性别、手机号抽取、身份证抽取、邮箱抽取、中日文人名库、中文缩写库、拆字词典、词汇情感值、停用词、反动词表、暴恐词表、繁简体转换、英文模拟中文发音、汪峰歌词生成器、职业名称词库、同义词库、反义词库、否定词库、汽…☆16May 6, 2020Updated 5 years ago
- pytorch版损失函数，改写自科学空间文章，【通过互信息思想来缓解类别不平衡问题】、【将“softmax+交叉熵”推广到多标签分类问题】☆12Aug 22, 2021Updated 4 years ago
- 中文文本分类，TextCNN，TextRNN，FastText，TextRCNN，BiLSTM_Attention，DPCNN，Transformer，基于pytorch，开箱即用。☆5,733Sep 23, 2020Updated 5 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- NLP中文预训练模型泛化能力挑战赛☆42Dec 11, 2020Updated 5 years ago
- Embedding, NMT, Text_Classification, Text_Generation, NER etc.☆571Jun 12, 2023Updated 2 years ago
- pytorch implementation for Patient Knowledge Distillation for BERT Model Compression☆204Sep 20, 2019Updated 6 years ago
- 中文长文本分类、短句子分类、多标签分类、两句子相似度（Chinese Text Classification of Keras NLP, multi-label classify, or sentence classify, long or short），字词句向量嵌入层（…☆1,811Jun 17, 2024Updated last year
- 使用rnn,lstm,gru,fasttext,textcnn,dpcnn,rnn-att,lstm-att,兼容huggleface/transformers，以及以transforemrs作为词嵌入模型，后面接入cnn、rnn、attention等等做文本分类。以及各个…☆518Dec 8, 2022Updated 3 years ago
- An implement of the paper of EDA for Chinese corpus.中文语料的EDA数据增强工具。NLP数据增强。论文阅读笔记。☆1,384May 31, 2022Updated 3 years ago
- 使用Bert，ERNIE，进行中文文本分类☆4,423Jun 28, 2024Updated last year
- Bert + PCNN and PCNN 中文关系抽取任务☆19Dec 30, 2022Updated 3 years ago
- 基于tensorflow的bilstm+crf的命名实体识别☆12Nov 15, 2020Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Keras implementation of graph convolutional networks for sequence labelling☆12Sep 21, 2018Updated 7 years ago
- Released code for「An Empirical Study of Sentiment-Enhanced Pre-Training for Aspect-Based Sentiment Analysis」in ACL2023.☆18Sep 7, 2023Updated 2 years ago
- 2021语言与智能技术竞赛：机器阅读理解任务☆29Jun 13, 2021Updated 4 years ago
- QAmatch(qa_match)/文本匹配/文本分类/文本embedding/文本聚类/文本检索（bow/ifidf/ngramtf-df/bert/albert/bm25/…/nn/gbdt/xgb/kmeans/dscan/faiss/….）☆931May 1, 2023Updated 3 years ago
- ccks baidu entity link 实体链接 第一名☆842Dec 19, 2023Updated 2 years ago
- Kashgari 框架的中文文档☆22Sep 11, 2020Updated 5 years ago
- 结合BERT+GRU+ATT模型，对自己收集的人物关系数据进行模型训练，用于人物关系抽取。☆323Mar 24, 2023Updated 3 years ago