Alternatives and similar repositories for Attention-is-All-you-Need-PyTorch

Users that are interested in Attention-is-All-you-Need-PyTorch are comparing it to the libraries listed below

• leaderj1001 / Synthesizer-Rethinking-Self-Attention-Transformer-Models
  Implementing SYNTHESIZER: Rethinking Self-Attention in Transformer Models using Pytorch
  ☆71Updated 5 years ago
• 10-zin / Synthesizer
  A PyTorch implementation of the paper - "Synthesizer: Rethinking Self-Attention in Transformer Models"
  ☆73Updated 3 years ago
• The-AI-Summer / simclr
  An education step by step implementation of SimCLR that accompanies the blogpost
  ☆31Updated 3 years ago
• sahajgarg / image_transformer
  Pytorch implementation of the image transformer for unconditional image generation
  ☆118Updated last year
• HyoungsungKim / Pytorch-tensorboard_tutorial
  Pytorch-tensorboard simple tutorial and example for a beginner
  ☆23Updated 5 years ago
• tango4j / tensorflow-vs-pytorch
  Guide for both TensorFlow and PyTorch in comparative way
  ☆108Updated 6 years ago
• b-etienne / Seq2seq-PyTorch
  ☆76Updated 5 years ago
• teddykoker / image-gpt
  PyTorch Implementation of OpenAI's Image GPT
  ☆260Updated 2 years ago
• lucidrains / feedback-transformer-pytorch
  Implementation of Feedback Transformer in Pytorch
  ☆108Updated 4 years ago
• vkakerbeck / Progressively-Growing-Networks
  Experiments on different dataset on how to grow networks during training to learn new image categories.
  ☆62Updated 5 years ago
• jaketae / g-mlp
  PyTorch implementation of Pay Attention to MLPs
  ☆40Updated 4 years ago
• sayakpaul / Supervised-Contrastive-Learning-in-TensorFlow-2
  Implements the ideas presented in https://arxiv.org/pdf/2004.11362v1.pdf by Khosla et al.
  ☆133Updated 5 years ago
• twistedcubic / attention-rank-collapse
  [ICML 2021 Oral] We show pure attention suffers rank collapse, and how different mechanisms combat it.
  ☆170Updated 4 years ago
• CyberZHG / torch-multi-head-attention
  Multi-head attention in PyTorch
  ☆156Updated 6 years ago
• lucidrains / contrastive-learner
  A simple to use pytorch wrapper for contrastive self-supervised learning on any neural network
  ☆150Updated 4 years ago
• sIncerass / powernorm
  [ICML 2020] code for "PowerNorm: Rethinking Batch Normalization in Transformers" https://arxiv.org/abs/2003.07845
  ☆120Updated 4 years ago
• dreamgonfly / transformer-pytorch
  A PyTorch implementation of Transformer in "Attention is All You Need"
  ☆106Updated 5 years ago
• epfml / collaborative-attention
  Code for Multi-Head Attention: Collaborate Instead of Concatenate
  ☆153Updated 2 years ago
• VainF / Awesome-Contrastive-Learning
  Awesome Contrastive Learning for CV & NLP
  ☆165Updated 4 years ago
• borisdayma / lightning-kitti
  Semantic Segmentation with Pytorch-Lightning
  ☆63Updated 5 years ago
• lucidrains / routing-transformer
  Fully featured implementation of Routing Transformer
  ☆299Updated 4 years ago
• suetAndTie / cycle-image-gan
  ☆28Updated 5 years ago
• takashiishida / flooding
  [ICML 2020] code for the flooding regularizer proposed in "Do We Need Zero Training Loss After Achieving Zero Training Error?"
  ☆95Updated 3 years ago
• dnddnjs / pytorch-multigpu
  Multi GPU Training Code for Deep Learning with PyTorch
  ☆210Updated 9 months ago
• nd7141 / icml2020
  Notebook for comprehensive analysis of authors, organizations, and countries of ICML 2020 papers.
  ☆56Updated 5 years ago
• gokulprasadthekkel / pytorch-multi-class-focal-loss
  ☆51Updated 5 years ago
• lucidrains / STAM-pytorch
  Implementation of STAM (Space Time Attention Model), a pure and simple attention model that reaches SOTA for video classification
  ☆135Updated 4 years ago
• srinadhu / CS231n
  My solutions for Assignments of CS231n: Convolutional Neural Networks for Visual Recognition
  ☆42Updated 7 years ago
• rishikksh20 / FNet-pytorch
  Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms
  ☆260Updated 4 years ago
• The-AI-Summer / RNN_tutorial
  Recurrent neural networks: building a custom LSTM/GRU cell in PyTorch
  ☆28Updated 5 years ago