murray-z / knowledge_distillation
knowledge distillation: 采用知识蒸馏,训练bert后指导textcnn
☆18Updated 3 years ago
Alternatives and similar repositories for knowledge_distillation:
Users that are interested in knowledge_distillation are comparing it to the libraries listed below
- NLP实验:新词挖掘+预训练模型继续Pre-training☆47Updated last year
- ☆39Updated 3 years ago
- TIANCHI-小布助手对话短文本语义匹配BERT baseline☆32Updated 4 years ago
- 使用多头的思想来进行命名实体识别☆33Updated 3 years ago
- Cascade bert+word vec and one layer FLAT, trained by adversarial FGM and Stochastic Weight Averaging☆23Updated 3 years ago
- 本项目是NLP领域一些任务的基准模型实现,包括文本分类、命名实体识别、实体关系抽取、NL2SQL、CKBQA以及BERT的各种下游任务应用。☆47Updated 4 years ago
- lic2020关系抽取比赛,使用Pytorch实现苏神的模型。☆101Updated 4 years ago
- Pytorch进行长文本分类。这里用到的网络有:FastText、TextCNN、TextRNN、TextRCNN、Transformer☆47Updated 4 years ago
- ☆32Updated 3 years ago
- multi-label,classifier,text classification,多标签文本分类,文本分类,BERT,ALBERT,multi-label-classification,seq2seq,attention,beam search☆32Updated 2 years ago
- ☆60Updated 5 years ago
- DataFountain第五届达观杯第4名方案☆50Updated 2 years ago
- CNN、BiLSTM、Bert(3layers)对Bert(12layers)模型的蒸馏的keras实现☆27Updated 5 years ago
- NLP关系抽取:序列标注、层叠式指针网络、Multi-head Selection、Deep Biaffine Attention☆100Updated 3 years ago
- 多标签文本分类☆30Updated 3 years ago
- CCKS2020 面向中文短文本的实体链指任务。主要思路为:使用基于BiLSTM和Attention的语义模型进行Query和Doc的文本匹配,再针对匹配度进行pairwise排序,从而选出最优的知识库实体。☆47Updated 4 years ago
- 中文无监督SimCSE Pytorch实现☆134Updated 3 years ago
- 中国中文信息学会社会媒体处理专业委员会举办的2019届中文人机对话之自然语言理解竞赛☆74Updated 5 years ago
- Label Mask for Multi-label Classification☆56Updated 3 years ago
- 基于prompt的中文文本分类。☆55Updated last year
- 实验苏神的CoSENT的Torch实现☆32Updated 3 years ago
- 句子匹配模型,包括无监督的SimCSE、ESimCSE、PromptBERT,和有监督的SBERT、CoSENT。☆98Updated 2 years ago
- implementation SlotGated SLU model for keras☆34Updated 4 years ago
- NER任务SOTA模型BERT_MRC☆61Updated last year
- 苏神SPACE pytorch版本复现☆42Updated 3 years ago
- 迭代膨胀卷积命名实体抽取☆45Updated 5 years ago
- ☆27Updated last year
- 文本分类baseline:BERT、半监督学习UDA、对抗学习、数据增强☆102Updated 4 years ago
- Bert分类,语义相似度,获取句向量。☆64Updated last month
- CCKS 2020:面向金融领域的小样本跨类迁移事件抽取。该项目实现基于MRC的事件抽取方法☆39Updated 2 years ago