Knowledge distillation in text classification with pytorch. 知识蒸馏，中文文本分类，教师模型BERT、XLNET，学生模型biLSTM。
☆229Jul 27, 2022Updated 3 years ago
Alternatives and similar repositories for KnowledgeDistillation
Users that are interested in KnowledgeDistillation are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- BERT distillation（基于BERT的蒸馏实验 ）☆316Jul 30, 2020Updated 5 years ago
- bert蒸馏实践，包含BiLSTM蒸馏BERT和TinyBert☆13Apr 23, 2022Updated 3 years ago
- 简洁易用版TinyBert：基于Bert进行知识蒸馏的预训练语言模型☆272Oct 24, 2020Updated 5 years ago
- knowledge distillation: 采用知识蒸馏，训练bert后指导textcnn☆19Apr 29, 2021Updated 4 years ago
- 基于Pytorch的知识蒸馏（中文文本分类）☆20Jan 12, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 复现论文《Distilling Task-Specific Knowledge from BERT into Simple Neural Networks》☆16Jun 13, 2021Updated 4 years ago
- Distilling Task-Specific Knowledge from BERT into Simple Neural Networks.☆15Aug 28, 2020Updated 5 years ago
- 使用Few-Shot方法来做文本分类任务，基于THUCNews数据☆10Jun 4, 2020Updated 5 years ago
- some demos of Knowledge Distillation in NLP☆23Dec 31, 2020Updated 5 years ago
- CNN、BiLSTM、Bert(3layers)对Bert(12layers)模型的蒸馏的keras实 现☆29Mar 3, 2020Updated 6 years ago
- Knowledge Distillation from BERT☆54Jan 7, 2019Updated 7 years ago
- A PyTorch-based knowledge distillation toolkit for natural language processing☆1,695May 8, 2023Updated 2 years ago
- Multi-Teacher Knowledge Distillation, code for my PhD dissertation. I used knowledge distillation as a decision-fusion and compressing m…☆28May 19, 2023Updated 2 years ago
- The score code of FastBERT (ACL2020)☆608Oct 29, 2021Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- multi-label，classifier，text classification，多标签文本分类，文本分类，BERT，ALBERT，multi-label-classification，seq2seq，attention，beam search☆32Jun 1, 2022Updated 3 years ago
- bert pytorch模型微调用于的多标签文本分类☆137Nov 8, 2019Updated 6 years ago
- Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。☆2,657May 30, 2023Updated 2 years ago
- pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注等任务,支持t5模型，支持GPT2进行文章续写。☆1,307Jun 18, 2022Updated 3 years ago
- 个人基于谷歌开源的BERT编写的文本分类器（基于微调方式），可自由加载NLP领域知名的预训练语言模型BERT、Bert-wwm、Roberta、ALBert以及ERNIE1.0☆167Aug 15, 2020Updated 5 years ago
- 达观算法比赛ner任务，从重新训练bert，到finetune预测。☆75Nov 2, 2022Updated 3 years ago
- “达观杯”NLP算法挑战赛 竞赛成绩：排名前1%（29/2885）☆16Sep 24, 2018Updated 7 years ago
- 中英文敏感词、语言检测、中外手机/电话归属地/运营商查询、名字推断性别、手机号抽取、身份证抽取、邮箱抽取、中日文人名库、中文缩写库、拆字词典、词汇情感值、停用词、反动词表、暴恐词表、繁简体转换、英文模拟中文发音、汪峰歌词生成器、职业名称词库、同义词库、反义词库、否定词库、汽…☆16May 6, 2020Updated 5 years ago
- pytorch版损失函数，改写自科学空间文章，【通过互信息思想来缓解类别不平衡问题】、【将“softmax+交叉熵”推广到多标签分类问题】☆12Aug 22, 2021Updated 4 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- 中文文本分类，TextCNN，TextRNN，FastText，TextRCNN，BiLSTM_Attention，DPCNN，Transformer，基于pytorch，开箱即用。☆5,729Sep 23, 2020Updated 5 years ago
- NLP中文预训练模型泛化能力挑战赛☆42Dec 11, 2020Updated 5 years ago
- Embedding, NMT, Text_Classification, Text_Generation, NER etc.☆570Jun 12, 2023Updated 2 years ago
- pytorch implementation for Patient Knowledge Distillation for BERT Model Compression☆204Sep 20, 2019Updated 6 years ago
- 中文长文本分类、短句子分类、多标签分类、两句子相似度（Chinese Text Classification of Keras NLP, multi-label classify, or sentence classify, long or short），字词句向量嵌入层（…☆1,810Jun 17, 2024Updated last year
- 使用rnn,lstm,gru,fasttext,textcnn,dpcnn,rnn-att,lstm-att,兼容huggleface/transformers，以及以transforemrs作为词嵌入模型，后面接入cnn、rnn、attention等等做文本分类。以及各个…☆519Dec 8, 2022Updated 3 years ago
- An implement of the paper of EDA for Chinese corpus.中文语料的EDA数据增强工具。NLP数据增强。论文阅读笔记。☆1,385May 31, 2022Updated 3 years ago
- 使用Bert，ERNIE，进行中文文本分类☆4,416Jun 28, 2024Updated last year
- Bert + PCNN and PCNN 中文关系抽取任务☆19Dec 30, 2022Updated 3 years ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- 基于tensorflow的bilstm+crf的命名实体识别☆12Nov 15, 2020Updated 5 years ago
- Keras implementation of graph convolutional networks for sequence labelling☆12Sep 21, 2018Updated 7 years ago
- Released code for「An Empirical Study of Sentiment-Enhanced Pre-Training for Aspect-Based Sentiment Analysis」in ACL2023.☆18Sep 7, 2023Updated 2 years ago
- 基于Pytorch的，中文语义相似度匹配模型（ABCNN、Albert、Bert、BIMPM、DecomposableAttention、DistilBert、ESIM、RE2、Roberta、SiaGRU、XlNet）☆798Mar 22, 2020Updated 6 years ago
- 2021语言与智能技术竞赛：机器阅读理解任务☆30Jun 13, 2021Updated 4 years ago
- QAmatch(qa_match)/文本 匹配/文本分类/文本embedding/文本聚类/文本检索（bow/ifidf/ngramtf-df/bert/albert/bm25/…/nn/gbdt/xgb/kmeans/dscan/faiss/….）☆931May 1, 2023Updated 2 years ago
- ccks baidu entity link 实体链接 第一名☆842Dec 19, 2023Updated 2 years ago