Alternatives and similar repositories for former

Users that are interested in former are comparing it to the libraries listed below

• gordicaleksa / pytorch-original-transformer
  My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing o…
  ☆1,043Updated 4 years ago
• sannykim / transformer
  A collection of resources to study Transformers in depth.
  ☆546Updated last year
• idiap / fast-transformers
  Pytorch library for fast transformer implementations
  ☆1,730Updated 2 years ago
• sooftware / attentions
  PyTorch implementation of some attentions for Deep Learning Researchers.
  ☆541Updated 3 years ago
• lucidrains / reformer-pytorch
  Reformer, the efficient Transformer, in Pytorch
  ☆2,182Updated 2 years ago
• harvardnlp / pytorch-struct
  Fast, general, and tested differentiable structured prediction in PyTorch
  ☆1,115Updated 3 years ago
• lucidrains / performer-pytorch
  An implementation of Performer, a linear attention-based transformer, in Pytorch
  ☆1,148Updated 3 years ago
• allenai / longformer
  Longformer: The Long-Document Transformer
  ☆2,162Updated 2 years ago
• rll / deepul
  ☆813Updated 5 months ago
• openai / sparse_attention
  Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"
  ☆1,588Updated 5 years ago
• JonasGeiping / cramming
  Cramming the training of a (BERT-type) language model into limited compute.
  ☆1,348Updated last year
• brandokoch / attention-is-all-you-need-paper
  Original transformer paper: Implementation of Vaswani, Ashish, et al. "Attention is all you need." Advances in neural information process…
  ☆240Updated last year
• karpathy / randomfun
  Notebooks and various random fun
  ☆1,103Updated 2 years ago
• vahidk / EffectivePyTorch
  PyTorch tutorials and best practices.
  ☆1,696Updated 5 months ago
• lilianweng / transformer-tensorflow
  Implementation of Transformer Model in Tensorflow
  ☆473Updated 2 years ago
• SamLynnEvans / Transformer
  Transformer seq2seq model, program that can build a language translator from parallel corpus
  ☆1,406Updated 2 years ago
• ml-jku / hopfield-layers
  Hopfield Networks is All You Need
  ☆1,846Updated 2 years ago
• deepgenerativemodels / notes
  Course notes
  ☆715Updated last year
• parrt / tensor-sensor
  The goal of this library is to generate more helpful exception messages for matrix algebra expressions for numpy, pytorch, jax, tensorflo…
  ☆811Updated 3 years ago
• sgrvinod / a-PyTorch-Tutorial-to-Transformers
  Attention Is All You Need | a PyTorch Tutorial to Transformers
  ☆338Updated last year
• FrancescoSaverioZuppichini / Pytorch-how-and-when-to-use-Module-Sequential-ModuleList-and-ModuleDict
  Code for my medium article
  ☆372Updated 5 years ago
• Paperspace / PyTorch-101-Tutorial-Series
  PyTorch 101 series covering everything from the basic building blocks all the way to building custom architectures.
  ☆265Updated 5 years ago
• google-research / long-range-arena
  Long Range Arena for Benchmarking Efficient Transformers
  ☆764Updated last year
• karpathy / deep-vector-quantization
  VQVAEs, GumbelSoftmaxes and friends
  ☆585Updated 3 years ago
• keitakurita / Practical_NLP_in_PyTorch
  A repository containing tutorials for practical NLP using PyTorch
  ☆538Updated 6 years ago
• jsbaan / transformer-from-scratch
  Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.
  ☆259Updated last year
• Kaixhin / grokking-pytorch
  The Hitchiker's Guide to PyTorch
  ☆1,198Updated 4 years ago
• Smerity / sha-rnn
  Single Headed Attention RNN - "Stop thinking with your head"
  ☆1,183Updated 3 years ago
• Lightning-AI / deep-learning-project-template
  Pytorch Lightning code guideline for conferences
  ☆1,279Updated last year
• kimiyoung / transformer-xl
  ☆3,669Updated 2 years ago