Alternatives and similar repositories for multi-head_self-attention

Users that are interested in multi-head_self-attention are comparing it to the libraries listed below

• CyberZHG / torch-multi-head-attention
  Multi-head attention in PyTorch
  ☆153Updated 6 years ago
• 0aqz0 / pytorch-attention-mechanism
  my codes for learning attention mechanism
  ☆50Updated 5 years ago
• wangz10 / contrastive_loss
  Experiments with supervised contrastive learning methods with different loss functions
  ☆220Updated 2 years ago
• anirudhshenoy / pseudo_labeling_small_datasets
  Pseudo Labeling for Neural Networks and Logistic Regression/SVMs ( Based on "Pseudo-Label : The Simple and Efficient Semi-Supervised Lear…
  ☆73Updated 5 years ago
• GuillaumeErhard / Supervised_contrastive_loss_pytorch
  Independent implementation of Supervised Contrastive Loss. Straight to the point and beyond
  ☆81Updated 4 years ago
• emadRad / lstm-gru-pytorch
  LSTM and GRU in PyTorch
  ☆262Updated 6 years ago
• hosseinshn / Basic-Multi-task-Learning
  This is a repository for Multi-task learning with toy data in Pytorch and Tensorflow
  ☆136Updated 6 years ago
• EscVM / Efficient-CapsNet
  Official TensorFlow code for the paper "Efficient-CapsNet: Capsule Network with Self-Attention Routing".
  ☆273Updated 3 years ago
• tuantle / regression-losses-pytorch
  Experimenting with different regression losses. Implemented in Pytorch.
  ☆147Updated 6 years ago
• sooftware / attentions
  PyTorch implementation of some attentions for Deep Learning Researchers.
  ☆534Updated 3 years ago
• asarigun / TransGAN
  This is a re-implementation of TransGAN: Two Pure Transformers Can Make One Strong GAN (NeurIPS 2021) in PyTorch.
  ☆113Updated last year
• frechele / SENet-PyTorch
  Squeeze and Excitation network implementation.
  ☆18Updated 6 years ago
• rishikksh20 / FNet-pytorch
  Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms
  ☆259Updated 4 years ago
• mathiaszinnen / focal_loss_torch
  Simple pytorch implementation of focal loss
  ☆86Updated 2 years ago
• WhatAShot / DANet
  DANets (a family of neural networks) for tabular data classification/ regression.
  ☆45Updated 3 years ago
• rishikksh20 / CrossViT-pytorch
  Implementation of CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification
  ☆203Updated 4 years ago
• ywatanabe1989 / custom_losses_pytorch
  Custom loss functions to use in (mainly) PyTorch.
  ☆39Updated 4 years ago
• dd1github / DeepSMOTE
  Pytorch implementation of "DeepSMOTE: Fusing Deep Learning and SMOTE for Imbalanced Data".
  ☆120Updated 4 years ago
• haohy / TCAN
  A PyTorch implementation of the TCAN model in "Temporal Convolutional Attention-based Network For Sequence Modeling".
  ☆142Updated 2 years ago
• pranjaldatta / Denoising-Autoencoder-in-Pytorch
  A Pytorch Implementation of a denoising autoencoder.
  ☆45Updated 6 years ago
• julianstastny / VAE-ResNet18-PyTorch
  A Variational Autoencoder based on the ResNet18-architecture
  ☆120Updated 6 years ago
• euranova / DAEMA
  This code reproduces the results presented in the paper "DAEMA: Denoising Autoencoder with Mask Attention" accepted at the ICANN 2021 con…
  ☆14Updated 3 years ago
• liujiyuan13 / MAE-code
  Pytorch implementation of Masked Auto-Encoder
  ☆40Updated 3 years ago
• AntonP999 / Sparse_autoencoder
  PyTorch implementation of sparse autoencoder.
  ☆39Updated 5 years ago
• google-research / deep_representation_one_class
  ☆155Updated last year
• tunz / transformer-pytorch
  Transformer implementation in PyTorch.
  ☆493Updated 6 years ago
• Anton-Cherepkov / gnn-mnist-classification
  Image classification using Graph Neural Networks (GNNs) with MNIST dataset
  ☆43Updated 2 years ago
• rishikksh20 / MLP-Mixer-pytorch
  Unofficial implementation of MLP-Mixer: An all-MLP Architecture for Vision
  ☆218Updated 4 years ago
• slaysd / pytorch-sentiment-analysis-classification
  A PyTorch Tutorials of Sentiment Analysis Classification (RNN, LSTM, Bi-LSTM, LSTM+Attention, CNN)
  ☆321Updated 2 years ago
• Spijkervet / contrastive-predictive-coding
  PyTorch implementation of Representation Learning with Contrastive Predictive Coding by Van den Oord et al. (2018)
  ☆86Updated 3 years ago