lizhenping / multi-head-self-attention
在sts数据集上用多头注意力机制上进行测试。 pytorch torchtext 代码简练,非常适合新手了解多头注意力机制的运作。不想transformer牵扯很多层 multi-head attention + one layer linear
☆17Updated 6 months ago
Alternatives and similar repositories for multi-head-self-attention
Users that are interested in multi-head-self-attention are comparing it to the libraries listed below
Sorting:
- BiLSTM 加普通Attention中文文本多分类Pytorch实现☆33Updated 4 years ago
- 文本分类, 双向lstm + attention 算法☆90Updated 4 years ago
- Pytorch Bert+BiLstm二分类☆42Updated 3 years ago
- 细粒度中文命名实体识别数据集处理,将json数据处理成BIOES标注的数据。CLUENER dataset pretreatment☆11Updated 4 years ago
- PyTorch使用BERT进行英语多标签文本分类☆33Updated 3 years ago
- 疫情期间网民情绪识别比赛分享+top1~3解决方案☆50Updated 4 years ago
- 基于tensorflow的中文文本分类(复旦中文语料)☆20Updated 4 years ago
- ☆11Updated 4 years ago
- pytorch实现的基于attention is all your need提出的Q,K,V的attention模板和派生的attention实现。☆21Updated 5 years ago
- 集成各种神经网络进行情感分类,包括CNN、LSTM、Transformer以及BERT等网络模型☆72Updated 6 years ago
- 存放知乎,博客发表文章中的代码☆47Updated 3 years ago
- 图网络和少样本学习在自然语言理解领域的前沿综述。本文旨在探索自然语言理解领域中(主要探索了命名实体识别,关系抽取)一些深度学习前沿的应用(主要探索了结合图神经网络和少样本学习场景的方法)共计15篇顶会论文(EMNLP,AAAI,ACL,COLING)。☆18Updated 4 years ago
- 天池-Datawhale 零基础入门NLP-新闻文本分类 最终榜Top10分享☆60Updated 4 years ago
- 采用bert进行事件抽取,[cls]进行事件分类,最后一层向量进行序列标注,两个任务同时训练。☆13Updated 3 years ago
- 利用bert预训练模型生成句向量或词向量☆27Updated 4 years ago
- 电商评论情感分类☆15Updated 4 years ago
- 文本分类baseline:BERT、半监督学习UDA、对抗学习、数据增强☆102Updated 4 years ago
- Pytorch进行长文本分类。这里用到的网络有:FastText、TextCNN、TextRNN、TextRCNN、Transformer☆48Updated 4 years ago
- pytorch implementation of multi-label text classification, includes kinds of models and pretrained. Especially for Chinese preprocessing.☆75Updated 5 years ago
- 主要是实现nlp常用网络以及结果比较,各模型的优劣势,如:FastText,TextCNN,TextRNN,TextRCNN,BiLSTM,Seq2seq,BERT,Transformer,ELMo以及Attention机制等等。☆45Updated 6 years ago
- Official code release for CNLE: Co-attention network with label embedding for text classification. Neurocomputing 2022☆21Updated last year
- Named Entity Recognition (NER) with different combinations of BiGRU, Self-Attention and CRF☆61Updated 4 years ago
- MixText: Linguistically-Informed Interpolation of Hidden Space for Semi-Supervised Text Classification☆23Updated 4 years ago
- Pytorch 文本分类温习练习,本项目主要针对短文本的简单分类,demo看看就好。这里用到的网络有:FastText、TextCNN、TextRNN、TextRCNN、Transformer☆16Updated 4 years ago
- Capsule, LSTM/GRU, CNN for text class implemented by Pytorch 胶囊网络, 循环神经网络和卷积神经网络在中文文本分类中的应用☆43Updated 6 years ago
- Summary and comparison of Chinese classification models☆34Updated 2 years ago
- 疫情期间网民情绪识别代码,包含lstm,bert,xlnet,robert,最高f1为0.725 部署在Google colab☆44Updated 4 years ago
- ☆30Updated 4 years ago
- Pytorch Implementation of Attention-Based BiLSTM for Relation Extraction ("Attention-Based Bidirectional Long Short-Term Memory Networks …☆44Updated 9 months ago
- Python实现中文文本关键词抽取,分别用了TF-IDF、LDA、RNN、LSTM和LR-SGD两类共五种方法,全网最全没有之一。☆61Updated 4 years ago