Alternatives and similar repositories for Attention-is-All-you-Need-PyTorch

Users that are interested in Attention-is-All-you-Need-PyTorch are comparing it to the libraries listed below

• leaderj1001 / Synthesizer-Rethinking-Self-Attention-Transformer-Models
  Implementing SYNTHESIZER: Rethinking Self-Attention in Transformer Models using Pytorch
  ☆70Updated 5 years ago
• HyoungsungKim / Pytorch-tensorboard_tutorial
  Pytorch-tensorboard simple tutorial and example for a beginner
  ☆23Updated 5 years ago
• b-etienne / Seq2seq-PyTorch
  ☆76Updated 5 years ago
• teddykoker / image-gpt
  PyTorch Implementation of OpenAI's Image GPT
  ☆260Updated 2 years ago
• suetAndTie / cycle-image-gan
  ☆28Updated 5 years ago
• The-AI-Summer / simclr
  An education step by step implementation of SimCLR that accompanies the blogpost
  ☆31Updated 3 years ago
• wangz10 / contrastive_loss
  Experiments with supervised contrastive learning methods with different loss functions
  ☆221Updated 2 years ago
• lucidrains / contrastive-learner
  A simple to use pytorch wrapper for contrastive self-supervised learning on any neural network
  ☆150Updated 4 years ago
• sahajgarg / image_transformer
  Pytorch implementation of the image transformer for unconditional image generation
  ☆118Updated last year
• lucidrains / feedback-transformer-pytorch
  Implementation of Feedback Transformer in Pytorch
  ☆108Updated 4 years ago
• nd7141 / icml2020
  Notebook for comprehensive analysis of authors, organizations, and countries of ICML 2020 papers.
  ☆56Updated 5 years ago
• sIncerass / powernorm
  [ICML 2020] code for "PowerNorm: Rethinking Batch Normalization in Transformers" https://arxiv.org/abs/2003.07845
  ☆120Updated 4 years ago
• lucidrains / STAM-pytorch
  Implementation of STAM (Space Time Attention Model), a pure and simple attention model that reaches SOTA for video classification
  ☆135Updated 4 years ago
• jaketae / g-mlp
  PyTorch implementation of Pay Attention to MLPs
  ☆41Updated 4 years ago
• The-AI-Summer / RNN_tutorial
  Recurrent neural networks: building a custom LSTM/GRU cell in PyTorch
  ☆28Updated 5 years ago
• takashiishida / flooding
  [ICML 2020] code for the flooding regularizer proposed in "Do We Need Zero Training Loss After Achieving Zero Training Error?"
  ☆93Updated 2 years ago
• sayakpaul / Supervised-Contrastive-Learning-in-TensorFlow-2
  Implements the ideas presented in https://arxiv.org/pdf/2004.11362v1.pdf by Khosla et al.
  ☆133Updated 5 years ago
• 10-zin / Synthesizer
  A PyTorch implementation of the paper - "Synthesizer: Rethinking Self-Attention in Transformer Models"
  ☆73Updated 2 years ago
• srinadhu / CS231n
  My solutions for Assignments of CS231n: Convolutional Neural Networks for Visual Recognition
  ☆42Updated 7 years ago
• kuixu / Linear-Multihead-Attention
  Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)
  ☆75Updated 5 years ago
• twistedcubic / attention-rank-collapse
  [ICML 2021 Oral] We show pure attention suffers rank collapse, and how different mechanisms combat it.
  ☆166Updated 4 years ago
• EscVM / Efficient-CapsNet
  Official TensorFlow code for the paper "Efficient-CapsNet: Capsule Network with Self-Attention Routing".
  ☆272Updated 3 years ago
• epfml / collaborative-attention
  Code for Multi-Head Attention: Collaborate Instead of Concatenate
  ☆151Updated 2 years ago
• ajamjoom / Image-Captions
  BERT + Image Captioning
  ☆134Updated 4 years ago
• lucidrains / routing-transformer
  Fully featured implementation of Routing Transformer
  ☆296Updated 3 years ago
• ayulockin / SwAV-TF
  TensorFlow implementation of "Unsupervised Learning of Visual Features by Contrasting Cluster Assignments".
  ☆86Updated 3 years ago
• VainF / Awesome-Contrastive-Learning
  Awesome Contrastive Learning for CV & NLP
  ☆165Updated 4 years ago
• rishikksh20 / FNet-pytorch
  Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms
  ☆259Updated 4 years ago
• lucidrains / adjacent-attention-network
  Graph neural network message passing reframed as a Transformer with local attention
  ☆69Updated 2 years ago
• zaidalyafeai / AttentioNN
  All about attention in neural networks. Soft attention, attention maps, local and global attention and multi-head attention.
  ☆234Updated 5 years ago