Alternatives and similar repositories for multi-head_self-attention

Users that are interested in multi-head_self-attention are comparing it to the libraries listed below

• mathiaszinnen / focal_loss_torch
  Simple pytorch implementation of focal loss
  ☆86Updated 2 years ago
• 0aqz0 / pytorch-attention-mechanism
  my codes for learning attention mechanism
  ☆50Updated 5 years ago
• EscVM / Efficient-CapsNet
  Official TensorFlow code for the paper "Efficient-CapsNet: Capsule Network with Self-Attention Routing".
  ☆274Updated 3 years ago
• CyberZHG / torch-multi-head-attention
  Multi-head attention in PyTorch
  ☆153Updated 6 years ago
• guocheng2025 / Transformer-Encoder
  Implementation of Transformer encoder in PyTorch
  ☆66Updated 4 years ago
• emla2805 / vision-transformer
  Tensorflow implementation of the Vision Transformer (An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale)
  ☆216Updated 4 years ago
• rishikksh20 / CrossViT-pytorch
  Implementation of CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification
  ☆204Updated 4 years ago
• anirudhshenoy / pseudo_labeling_small_datasets
  Pseudo Labeling for Neural Networks and Logistic Regression/SVMs ( Based on "Pseudo-Label : The Simple and Efficient Semi-Supervised Lear…
  ☆73Updated 5 years ago
• hosseinshn / Basic-Multi-task-Learning
  This is a repository for Multi-task learning with toy data in Pytorch and Tensorflow
  ☆136Updated 6 years ago
• tunz / transformer-pytorch
  Transformer implementation in PyTorch.
  ☆492Updated 6 years ago
• rishikksh20 / FNet-pytorch
  Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms
  ☆259Updated 4 years ago
• sooftware / attentions
  PyTorch implementation of some attentions for Deep Learning Researchers.
  ☆534Updated 3 years ago
• JayPatwardhan / ResNet-PyTorch
  Basic implementation of ResNet 50, 101, 152 in PyTorch
  ☆106Updated 3 years ago
• emadRad / lstm-gru-pytorch
  LSTM and GRU in PyTorch
  ☆261Updated 6 years ago
• The-AI-Summer / RNN_tutorial
  Recurrent neural networks: building a custom LSTM/GRU cell in PyTorch
  ☆28Updated 4 years ago
• tuantle / regression-losses-pytorch
  Experimenting with different regression losses. Implemented in Pytorch.
  ☆147Updated 6 years ago
• wangz10 / contrastive_loss
  Experiments with supervised contrastive learning methods with different loss functions
  ☆220Updated 2 years ago
• frechele / SENet-PyTorch
  Squeeze and Excitation network implementation.
  ☆18Updated 6 years ago
• tczhangzhi / VisionTransformer-Pytorch
  ☆72Updated 4 years ago
• jan-xu / autoencoders
  Various autoencoders with ResNet, DenseNet and U-Net implementations, as well as VAE and GAN implementations.
  ☆38Updated last year
• euranova / DAEMA
  This code reproduces the results presented in the paper "DAEMA: Denoising Autoencoder with Mask Attention" accepted at the ICANN 2021 con…
  ☆14Updated 3 years ago
• Mayurji / Image-Classification-PyTorch
  Learning and Building Convolutional Neural Networks using PyTorch
  ☆213Updated 3 years ago
• jingpingjiao / siamese_cnn
  Pytorch implementation of Siamese networks that learns to classify its inputs, the neural networks learns to differentiate between two pe…
  ☆32Updated 6 years ago
• pranjaldatta / Denoising-Autoencoder-in-Pytorch
  A Pytorch Implementation of a denoising autoencoder.
  ☆45Updated 6 years ago
• Peachypie98 / CBAM
  CBAM: Convolutional Block Attention Module for CIFAR100 on VGG19
  ☆54Updated 2 months ago
• Anton-Cherepkov / gnn-mnist-classification
  Image classification using Graph Neural Networks (GNNs) with MNIST dataset
  ☆43Updated 2 years ago
• ywatanabe1989 / custom_losses_pytorch
  Custom loss functions to use in (mainly) PyTorch.
  ☆39Updated 4 years ago
• liujiyuan13 / MAE-code
  Pytorch implementation of Masked Auto-Encoder
  ☆40Updated 3 years ago
• mengjizhiyou / pytorch_model
  wirte simple models by pytorch,such as lstm/gru/bilstm
  ☆38Updated 2 years ago
• senadkurtisi / pytorch-GCN
  PyTorch implementation of the Graph Convolutional Network by Kipf et al.
  ☆27Updated 4 years ago