lizhenping / multi-head-self-attentionLinks
在sts数据集上用多头注意力机制上进行测试。 pytorch torchtext 代码简练,非常适合新手了解多头注意力机制的运作。不想transformer牵扯很多层 multi-head attention + one layer linear
☆18Updated 3 months ago
Alternatives and similar repositories for multi-head-self-attention
Users that are interested in multi-head-self-attention are comparing it to the libraries listed below
Sorting:
- BiLSTM 加普通Attention中文文本多分类Pytorch实现☆33Updated 4 years ago
- 文本分类, 双向lstm + attention 算法☆90Updated 5 years ago
- Pytorch Bert+BiLstm二分类☆40Updated 4 years ago
- ☆166Updated 6 years ago
- 使用pytorch搭建textCNN实现中文文本分类☆132Updated 6 years ago
- Named Entity Recognition (NER) with different combinations of BiGRU, Self-Attention and CRF☆63Updated 4 years ago
- Pytorch 文本分类温习练习,本项目主要针对短文本的简单分类,demo看看就好。这里用到的网络有:FastText、TextCNN、TextRNN、TextRCNN、Transformer☆17Updated 5 years ago
- pytorch实现的基于attention is all your need提出的Q,K,V的attention模板和派生的attention实现。☆21Updated 5 years ago
- ☆277Updated 3 years ago
- pytorch implementation of multi-label text classification, includes kinds of models and pretrained. Especially for Chinese preprocessing.☆78Updated 6 years ago
- 基于tensorflow的中文文本分类(复旦中文语料)☆21Updated 5 years ago
- 集成各种神经网络进行情感分类,包括CNN、LSTM、Transformer以及BERT等网络模型☆73Updated 6 years ago
- 疫情期间网民情绪识别代码,包含lstm,bert,xlnet,robert,最高f1为0.725 部署在Google colab☆44Updated 5 years ago
- PyTorch implementation of some text classification models (HAN, fastText, BiLSTM-Attention, TextCNN, Transformer) | 文本分类☆152Updated 4 years ago
- Pytorch进行长文本分类。这里用到的网络有:FastText、TextCNN、TextRNN、TextRCNN、Transformer☆48Updated 5 years ago
- 基于Transformers的文本分类☆341Updated 4 years ago
- Implementation of some unbalanced loss like focal_loss, dice_loss, DSC Loss, GHM Loss et.al☆268Updated 2 years ago
- 基于word2vec预训练词向量; textCNN 模型 ;charCNN 模型 ;Bi-LSTM模型;Bi-LSTM + Attention 模型 ;Transformer 模型 ;ELMo 预训练模型 ;BERT 预训练模型的文本分类项目☆125Updated 5 years ago
- ☆29Updated 5 years ago
- 文本聚类(Kmeans、DBSCAN、LDA、Single-pass)☆353Updated 4 years ago
- 文本分类baseline:BERT、半监督学习UDA、对抗学习、数据增强☆104Updated 4 years ago
- Bert-Pytorch-Chinese-TextClassification☆27Updated 3 years ago
- 电商评论情感分类☆15Updated 5 years ago
- 疫情期间网民情绪识别比赛分享+top1~3解决方案☆51Updated 5 years ago
- 采用bert进行事件抽取,[cls]进行事件分类,最后一层向量进行序列标注,两个任务同时训练。☆13Updated 4 years ago
- Pytorch Implementation of Attention-Based BiLSTM for Relation Extraction ("Attention-Based Bidirectional Long Short-Term Memory Networks …☆45Updated last year
- PyTorch使用BERT进行英语多标签文本分类☆34Updated 3 years ago
- 多标签多分类的textCNN☆12Updated 5 years ago
- question classification with multi-level attention mechanism 使用多层级注意力机制和keras实现问题分类☆34Updated 6 years ago
- 基于pytorch框架,针对文本分类的机器学习项目,集成多种算法(xgboost, lstm, bert, mezha等等),提供基础数据集,开箱即用,方便自己二次拓展,持续更新☆33Updated 2 years ago