Knowledge distillation in text classification with pytorch. 知识蒸馏，中文文本分类，教师模型BERT、XLNET，学生模型biLSTM。
☆231Jul 27, 2022Updated 3 years ago
Alternatives and similar repositories for KnowledgeDistillation
Users that are interested in KnowledgeDistillation are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- BERT distillation（基于BERT的蒸馏实验 ）☆317Jul 30, 2020Updated 5 years ago
- bert蒸馏实践，包含BiLSTM蒸馏BERT和TinyBert☆13Apr 23, 2022Updated 4 years ago
- 简洁易用版TinyBert：基于Bert进行知识蒸馏的预训练语言模型☆272Oct 24, 2020Updated 5 years ago
- knowledge distillation: 采用知识蒸馏，训练bert后指导textcnn☆19Apr 29, 2021Updated 5 years ago
- 基于Pytorch的知识蒸馏（中文文本分类）☆23Jan 12, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- 复现论文《Distilling Task-Specific Knowledge from BERT into Simple Neural Networks》☆16Jun 13, 2021Updated 5 years ago
- Distilling Task-Specific Knowledge from BERT into Simple Neural Networks.☆15Aug 28, 2020Updated 5 years ago
- 使用Few-Shot方法来做文本分类任务，基于THUCNews数据☆10Jun 4, 2020Updated 6 years ago
- some demos of Knowledge Distillation in NLP☆23Dec 31, 2020Updated 5 years ago
- CNN、BiLSTM、Bert(3layers)对Bert(12layers)模型的蒸馏的keras实现☆29Mar 3, 2020Updated 6 years ago
- Knowledge Distillation from BERT☆54Jan 7, 2019Updated 7 years ago
- A PyTorch-based knowledge distillation toolkit for natural language processing☆1,702May 8, 2023Updated 3 years ago
- The score code of FastBERT (ACL2020)☆607Oct 29, 2021Updated 4 years ago
- multi-label，classifier，text classification，多标签文本分类，文本分类，BERT，ALBERT，multi-label-classification，seq2seq，attention，beam search☆32Jun 1, 2022Updated 4 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- bert pytorch模型微调用于的多标签文本分类☆135Nov 8, 2019Updated 6 years ago
- Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。☆2,664May 30, 2023Updated 3 years ago
- pytorch实现 Bert 做seq2seq任务，使用unilm方案,现在也可以做自动摘要，文本分类，情感分析，NER，词性标注等任务,支持t5模型，支持GPT2进行 文章续写。☆1,306Jun 18, 2022Updated 3 years ago
- 个人基于谷歌开源的BERT编写的文本分类器（基于微调方式），可自由加载NLP领域知名的预训练语言模型BERT、Bert-wwm、Roberta、ALBert以及ERNIE1.0☆167Aug 15, 2020Updated 5 years ago
- 达观算法比赛ner任务，从重新训练bert，到finetune预测。☆75Nov 2, 2022Updated 3 years ago
- “达观杯”NLP算法挑战赛 竞赛成绩：排名前1%（29/2885）☆16Sep 24, 2018Updated 7 years ago
- 中英文敏感词、语言检测、中外手机/电话归属地/运营商查询、名字推断性别、手机号抽取、身份证抽取、邮箱抽取、中日文人名库、中文缩写库、拆字词典、词汇情感值、停用词、反动词表、暴恐词表、繁简体转换、英文模拟中文发音、汪峰歌词生成器、职业名称词库、同义词库、反义词库、否定词库、汽…☆16May 6, 2020Updated 6 years ago
- pytorch版损失函数，改写自科学空间文章，【通过互信息思想来缓解类别不平衡问题】、【将“softmax+交叉熵”推广到多标签分类问题】☆12Aug 22, 2021Updated 4 years ago
- 中文文本分类，TextCNN，TextRNN，FastText，TextRCNN，BiLSTM_Attention，DPCNN，Transformer，基于pytorch，开箱即用。☆5,731Sep 23, 2020Updated 5 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- NLP中文预训练模型泛化能力挑战赛☆42Dec 11, 2020Updated 5 years ago
- Embedding, NMT, Text_Classification, Text_Generation, NER etc.☆570Jun 12, 2023Updated 3 years ago
- pytorch implementation for Patient Knowledge Distillation for BERT Model Compression☆204Sep 20, 2019Updated 6 years ago
- 中文长文本分类、短句子分类、多标签分类、两句子相似度（Chinese Text Classification of Keras NLP, multi-label classify, or sentence classify, long or short），字词句向量嵌入层（…☆1,815Jun 17, 2024Updated last year
- 使用rnn,lstm,gru,fasttext,textcnn,dpcnn,rnn-att,lstm-att,兼容huggleface/transformers，以及以transforemrs作为词嵌入模型，后面接入cnn、rnn、attention等等做文本分类。以及各个…☆518Dec 8, 2022Updated 3 years ago
- An implement of the paper of EDA for Chinese corpus.中文语料的EDA数据增强工具。NLP数据增强。论文阅读笔记。☆1,384May 31, 2022Updated 4 years ago
- 使用Bert，ERNIE，进行中文文本分类☆4,425Jun 28, 2024Updated last year
- Bert + PCNN and PCNN 中文关系抽取任务☆20Dec 30, 2022Updated 3 years ago
- 基于tensorflow的bilstm+crf的命名实体识别☆12Nov 15, 2020Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Keras implementation of graph convolutional networks for sequence labelling☆12Sep 21, 2018Updated 7 years ago
- Released code for「An Empirical Study of Sentiment-Enhanced Pre-Training for Aspect-Based Sentiment Analysis」in ACL2023.☆18Sep 7, 2023Updated 2 years ago
- 基于Pytorch的，中文语义相似度匹配 模型（ABCNN、Albert、Bert、BIMPM、DecomposableAttention、DistilBert、ESIM、RE2、Roberta、SiaGRU、XlNet）☆797Mar 22, 2020Updated 6 years ago
- 2021语言与智能技术竞赛：机器阅读理解任务☆29Jun 13, 2021Updated 5 years ago
- QAmatch(qa_match)/文本匹配/文本分类/文本embedding/文本聚类/文本检索（bow/ifidf/ngramtf-df/bert/albert/bm25/…/nn/gbdt/xgb/kmeans/dscan/faiss/….）☆931May 1, 2023Updated 3 years ago
- ccks baidu entity link 实体链接 第一名☆841Dec 19, 2023Updated 2 years ago
- Kashgari 框架的中文文档☆22Sep 11, 2020Updated 5 years ago