Alternatives and similar repositories for multi-head_self-attention:

Users that are interested in multi-head_self-attention are comparing it to the libraries listed below

• CyberZHG / torch-multi-head-attention
  Multi-head attention in PyTorch
  ☆150Updated 5 years ago
• 0aqz0 / pytorch-attention-mechanism
  my codes for learning attention mechanism
  ☆50Updated 4 years ago
• rishikksh20 / CrossViT-pytorch
  Implementation of CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification
  ☆193Updated 3 years ago
• emla2805 / vision-transformer
  Tensorflow implementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale)
  ☆213Updated 4 years ago
• liujiyuan13 / MAE-code
  Pytorch implementation of Masked Auto-Encoder
  ☆39Updated 3 years ago
• quanghuy0497 / Transformers4Vision
  A summarization of Transformer-based architectures for CV tasks, including image classification, object detection, segmentation, and Few-…
  ☆107Updated 2 years ago
• ywatanabe1989 / custom_losses_pytorch
  Custom loss functions to use in (mainly) PyTorch.
  ☆38Updated 4 years ago
• WangFeng18 / Swin-Transformer
  Implementation of Swin Transformer with Pytorch
  ☆110Updated 3 years ago
• wangz10 / contrastive_loss
  Experiments with supervised contrastive learning methods with different loss functions
  ☆218Updated 2 years ago
• The-AI-Summer / simclr
  An education step by step implementation of SimCLR that accompanies the blogpost
  ☆32Updated 2 years ago
• rishikksh20 / FNet-pytorch
  Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms
  ☆258Updated 3 years ago
• guocheng2025 / Transformer-Encoder
  Implementation of Transformer encoder in PyTorch
  ☆65Updated 4 years ago
• mathiaszinnen / focal_loss_torch
  Simple pytorch implementation of focal loss
  ☆84Updated last year
• sooftware / attentions
  PyTorch implementation of some attentions for Deep Learning Researchers.
  ☆523Updated 2 years ago
• Anton-Cherepkov / gnn-mnist-classification
  Image classification using Graph Neural Networks (GNNs) with MNIST dataset
  ☆37Updated 2 years ago
• slaysd / pytorch-sentiment-analysis-classification
  A PyTorch Tutorials of Sentiment Analysis Classification (RNN, LSTM, Bi-LSTM, LSTM+Attention, CNN)
  ☆301Updated last year
• antonyvigouret / Pay-Attention-to-MLPs
  My implementation of the gMLP model from the paper "Pay Attention to MLPs".
  ☆24Updated 3 years ago
• tuantle / regression-losses-pytorch
  Experimenting with different regression losses. Implemented in Pytorch.
  ☆145Updated 6 years ago
• okojoalg / sequencer
  Sequencer: Deep LSTM for Image Classification
  ☆140Updated 2 years ago
• dragon-wang / VAE
  Implementation of VAE and CVAE using Pytorch on MNIST dataset
  ☆88Updated 3 years ago
• mnikitin / channel-attention
  Gluon implementation of channel-attention modules: SE, ECA, GCT
  ☆38Updated 4 years ago
• GuillaumeErhard / Supervised_contrastive_loss_pytorch
  Independent implementation of Supervised Contrastive Loss. Straight to the point and beyond
  ☆79Updated 4 years ago
• mengjizhiyou / pytorch_model
  wirte simple models by pytorch,such as lstm/gru/bilstm
  ☆37Updated 2 years ago
• liuruiyang98 / Jittor-MLP
  Unofficial Implementation of MLP-Mixer, gMLP, resMLP, Vision Permutator, S2MLP, S2MLPv2, RaftMLP, HireMLP, ConvMLP, AS-MLP, SparseMLP, Co…
  ☆170Updated 2 years ago
• afters-cool / transformer
  Implementation of Transformer model (originally from Attention is All You Need) applied to Time Series.
  ☆27Updated 3 years ago
• ElektrischesSchaf / LayerNorm_GRU
  Implement layer normalization GRU in pytorch
  ☆33Updated last year
• lucidrains / FLASH-pytorch
  Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"
  ☆358Updated last year
• lironui / Linear-Attention-Mechanism
  Attention mechanism
  ☆54Updated 3 years ago
• ttchengab / mixup
  ☆19Updated 3 years ago
• aryan-jadon / Medium-Articles-Notebooks
  Medium Articles Notebooks and Media Files
  ☆15Updated 10 months ago