Alternatives and similar repositories for torch-multi-head-attention:

Users that are interested in torch-multi-head-attention are comparing it to the libraries listed below

• evelinehong / Transformer_Relative_Position_PyTorch
  Implement the paper "Self-Attention with Relative Position Representations"
  ☆125Updated 4 years ago
• FreedomIntelligence / complex-order
  ☆83Updated 5 years ago
• Spijkervet / contrastive-predictive-coding
  PyTorch implementation of Representation Learning with Contrastive Predictive Coding by Van den Oord et al. (2018)
  ☆83Updated 3 years ago
• leaderj1001 / Synthesizer-Rethinking-Self-Attention-Transformer-Models
  Implementing SYNTHESIZER: Rethinking Self-Attention in Transformer Models using Pytorch
  ☆70Updated 4 years ago
• liujiarik / nlp_clip_pytorch
  star_transformer pytorch
  ☆27Updated 5 years ago
• wangz10 / contrastive_loss
  Experiments with supervised contrastive learning methods with different loss functions
  ☆218Updated 2 years ago
• leviswind / pytorch-transformer
  pytorch implementation of Attention is all you need
  ☆240Updated 3 years ago
• woozch / PCGrad-pytorch-example
  PCGrad pytorch sample code [not official]
  ☆30Updated 4 years ago
• LiUzHiAn / VAE-Pytorch
  ☆64Updated 5 years ago
• DuaneNielsen / DeepInfomaxPytorch
  Learning deep representations by mutual information estimation and maximization
  ☆324Updated 6 years ago
• jaketae / g-mlp
  PyTorch implementation of Pay Attention to MLPs
  ☆40Updated 3 years ago
• OpenNLPLab / cosFormer
  [ICLR 2022] Official implementation of cosformer-attention in cosFormer: Rethinking Softmax in Attention
  ☆185Updated 2 years ago
• cyk1337 / Transformer-in-PyTorch
  Transformer/Transformer-XL/R-Transformer examples and explanations
  ☆26Updated 3 years ago
• DSE-MSU / R-transformer
  Pytorch implementation of R-Transformer. Some parts of the code are adapted from the implementation of TCN and Transformer.
  ☆226Updated 5 years ago
• lancopku / Explicit-Sparse-Transformer
  code for Explicit Sparse Transformer
  ☆57Updated last year
• cloneofsimo / realformer-pytorch
  Implementation of RealFormer using pytorch
  ☆101Updated 4 years ago
• rishikksh20 / FNet-pytorch
  Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms
  ☆256Updated 3 years ago
• lzy1732008 / GaussionTransformer
  For paper《Gaussian Transformer: A Lightweight Approach for Natural Language Inference》
  ☆29Updated 4 years ago
• YongfeiYan / Gumbel_Softmax_VAE
  PyTorch implementation of a Variational Autoencoder with Gumbel-Softmax Distribution
  ☆204Updated 6 years ago
• mttk / rnn-classifier
  Minimal RNN classifier with self-attention in Pytorch
  ☆150Updated 3 years ago
• monk1337 / Various-Attention-mechanisms
  This repository contain various types of attention mechanism like Bahdanau , Soft attention , Additive Attention , Hierarchical Attention…
  ☆125Updated 3 years ago
• janfreyberg / pytorch-revgrad
  A minimal pytorch package implementing a gradient reversal layer.
  ☆157Updated 2 months ago
• lancopku / AdaNorm
  Code for "Understanding and Improving Layer Normalization"
  ☆46Updated 5 years ago
• valdersoul / bn-vae
  ☆32Updated 4 years ago
• makezur / VIB_pytorch
  an implementation of Deep Variational Informational Bottleneck in pytorch (https://arxiv.org/pdf/1612.00410.pdf)
  ☆33Updated 6 years ago
• gitabcworld / skiprnn_pytorch
  A pytorch implementation of the paper: "Skip RNN: Learning to Skip State Updates in Recurrent Neural Networks"
  ☆81Updated 6 years ago
• lucidrains / FLASH-pytorch
  Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"
  ☆357Updated last year
• thomlake / pytorch-attention
  pytorch neural network attention mechanism
  ☆148Updated 5 years ago
• wuch15 / Fastformer
  A pytorch &keras implementation and demo of Fastformer.
  ☆188Updated 2 years ago
• kuixu / Linear-Multihead-Attention
  Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)
  ☆72Updated 4 years ago