Alternatives and similar repositories for former

Users that are interested in former are comparing it to the libraries listed below

• gordicaleksa / pytorch-original-transformer
  My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing o…
  ☆1,038Updated 4 years ago
• sannykim / transformer
  A collection of resources to study Transformers in depth.
  ☆543Updated last year
• idiap / fast-transformers
  Pytorch library for fast transformer implementations
  ☆1,727Updated 2 years ago
• harvardnlp / pytorch-struct
  Fast, general, and tested differentiable structured prediction in PyTorch
  ☆1,113Updated 3 years ago
• Lightning-AI / deep-learning-project-template
  Pytorch Lightning code guideline for conferences
  ☆1,279Updated last year
• vahidk / EffectivePyTorch
  PyTorch tutorials and best practices.
  ☆1,693Updated 4 months ago
• rll / deepul
  ☆812Updated 4 months ago
• allenai / longformer
  Longformer: The Long-Document Transformer
  ☆2,159Updated 2 years ago
• ml-jku / hopfield-layers
  Hopfield Networks is All You Need
  ☆1,838Updated 2 years ago
• JonasGeiping / cramming
  Cramming the training of a (BERT-type) language model into limited compute.
  ☆1,345Updated last year
• lucidrains / reformer-pytorch
  Reformer, the efficient Transformer, in Pytorch
  ☆2,180Updated 2 years ago
• openai / sparse_attention
  Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"
  ☆1,584Updated 5 years ago
• bentrevett / pytorch-seq2seq
  Tutorials on implementing a few sequence-to-sequence (seq2seq) models with PyTorch and TorchText.
  ☆5,597Updated last year
• google-research / long-range-arena
  Long Range Arena for Benchmarking Efficient Transformers
  ☆762Updated last year
• sooftware / attentions
  PyTorch implementation of some attentions for Deep Learning Researchers.
  ☆534Updated 3 years ago
• FrancescoSaverioZuppichini / Pytorch-how-and-when-to-use-Module-Sequential-ModuleList-and-ModuleDict
  Code for my medium article
  ☆372Updated 4 years ago
• lilianweng / transformer-tensorflow
  Implementation of Transformer Model in Tensorflow
  ☆472Updated 2 years ago
• jsbaan / transformer-from-scratch
  Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.
  ☆256Updated last year
• huggingface / awesome-papers
  Papers & presentation materials from Hugging Face's internal science day
  ☆2,048Updated 4 years ago
• abhimishra91 / transformers-tutorials
  Github repo with tutorials to fine tune transformers for diff NLP tasks
  ☆856Updated last year
• deepgenerativemodels / notes
  Course notes
  ☆708Updated last year
• brandokoch / attention-is-all-you-need-paper
  Original transformer paper: Implementation of Vaswani, Ashish, et al. "Attention is all you need." Advances in neural information process…
  ☆239Updated last year
• Paperspace / PyTorch-101-Tutorial-Series
  PyTorch 101 series covering everything from the basic building blocks all the way to building custom architectures.
  ☆264Updated 5 years ago
• Kaixhin / grokking-pytorch
  The Hitchiker's Guide to PyTorch
  ☆1,197Updated 3 years ago
• bhoov / exbert
  A Visual Analysis Tool to Explore Learned Representations in Transformers Models
  ☆599Updated last year
• neubig / lowresource-nlp-bootcamp-2020
  The website for the CMU Language Technologies Institute low resource NLP bootcamp 2020
  ☆600Updated 5 years ago
• dair-ai / Transformers-Recipe
  🧠 A study guide to learn about Transformers
  ☆1,605Updated 2 years ago
• lucidrains / performer-pytorch
  An implementation of Performer, a linear attention-based transformer, in Pytorch
  ☆1,144Updated 3 years ago
• google-research / bigbird
  Transformers for Longer Sequences
  ☆618Updated 2 years ago
• markriedl / transformer-walkthrough
  A walkthrough of transformer architecture code
  ☆352Updated last year