Alternatives and similar repositories for Attention-is-All-you-Need-PyTorch

Users that are interested in Attention-is-All-you-Need-PyTorch are comparing it to the libraries listed below

• leaderj1001 / Synthesizer-Rethinking-Self-Attention-Transformer-Models
  Implementing SYNTHESIZER: Rethinking Self-Attention in Transformer Models using Pytorch
  ☆70Updated 5 years ago
• suetAndTie / cycle-image-gan
  ☆28Updated 5 years ago
• sahajgarg / image_transformer
  Pytorch implementation of the image transformer for unconditional image generation
  ☆118Updated last year
• b-etienne / Seq2seq-PyTorch
  ☆76Updated 5 years ago
• tango4j / tensorflow-vs-pytorch
  Guide for both TensorFlow and PyTorch in comparative way
  ☆108Updated 6 years ago
• sIncerass / powernorm
  [ICML 2020] code for "PowerNorm: Rethinking Batch Normalization in Transformers" https://arxiv.org/abs/2003.07845
  ☆120Updated 4 years ago
• wangz10 / contrastive_loss
  Experiments with supervised contrastive learning methods with different loss functions
  ☆221Updated 2 years ago
• takashiishida / flooding
  [ICML 2020] code for the flooding regularizer proposed in "Do We Need Zero Training Loss After Achieving Zero Training Error?"
  ☆93Updated 2 years ago
• ajamjoom / Image-Captions
  BERT + Image Captioning
  ☆134Updated 4 years ago
• jaketae / g-mlp
  PyTorch implementation of Pay Attention to MLPs
  ☆40Updated 4 years ago
• The-AI-Summer / simclr
  An education step by step implementation of SimCLR that accompanies the blogpost
  ☆31Updated 3 years ago
• teddykoker / image-gpt
  PyTorch Implementation of OpenAI's Image GPT
  ☆258Updated last year
• 10-zin / Synthesizer
  A PyTorch implementation of the paper - "Synthesizer: Rethinking Self-Attention in Transformer Models"
  ☆73Updated 2 years ago
• dreamgonfly / transformer-pytorch
  A PyTorch implementation of Transformer in "Attention is All You Need"
  ☆106Updated 4 years ago
• dnddnjs / pytorch-multigpu
  Multi GPU Training Code for Deep Learning with PyTorch
  ☆207Updated 6 months ago
• twistedcubic / attention-rank-collapse
  [ICML 2021 Oral] We show pure attention suffers rank collapse, and how different mechanisms combat it.
  ☆166Updated 4 years ago
• lucidrains / contrastive-learner
  A simple to use pytorch wrapper for contrastive self-supervised learning on any neural network
  ☆148Updated 4 years ago
• lucidrains / STAM-pytorch
  Implementation of STAM (Space Time Attention Model), a pure and simple attention model that reaches SOTA for video classification
  ☆135Updated 4 years ago
• epfml / collaborative-attention
  Code for Multi-Head Attention: Collaborate Instead of Concatenate
  ☆151Updated 2 years ago
• leimao / Two-Layer-Hierarchical-Softmax-PyTorch
  Two-Layer Hierarchical Softmax Implementation for PyTorch
  ☆70Updated 4 years ago
• AaronCCWong / Show-Attend-and-Tell
  A PyTorch implementation of the paper Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
  ☆84Updated 5 years ago
• kuixu / Linear-Multihead-Attention
  Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)
  ☆75Updated 5 years ago
• lucidrains / routing-transformer
  Fully featured implementation of Routing Transformer
  ☆298Updated 3 years ago
• Kirill-Kravtsov / drophead-pytorch
  An implementation of drophead regularization for pytorch transformers
  ☆19Updated 4 years ago
• HyoungsungKim / Pytorch-tensorboard_tutorial
  Pytorch-tensorboard simple tutorial and example for a beginner
  ☆23Updated 5 years ago
• fangleai / TransformerCVAE
  Transformer-based Conditional Variational Autoencoder for Controllable Story Generation
  ☆158Updated 3 years ago
• leaderj1001 / PSPNet
  Implementing Pyramid Scene Parsing Network (PSPNet) paper using Pytorch
  ☆16Updated 5 years ago
• lucidrains / cross-transformers-pytorch
  Implementation of Cross Transformer for spatially-aware few-shot transfer, in Pytorch
  ☆54Updated 4 years ago
• VainF / Awesome-Contrastive-Learning
  Awesome Contrastive Learning for CV & NLP
  ☆164Updated 4 years ago
• littleredxh / HardNegative
  ☆53Updated 4 years ago