pbloem / formerLinks
Simple transformer implementation from scratch in pytorch. (archival, latest version on codeberg)
☆1,093Updated 8 months ago
Alternatives and similar repositories for former
Users that are interested in former are comparing it to the libraries listed below
Sorting:
- My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing o…☆1,073Updated 4 years ago
- A collection of resources to study Transformers in depth.☆558Updated 2 years ago
- Fast, general, and tested differentiable structured prediction in PyTorch☆1,118Updated 3 years ago
- ☆825Updated 7 months ago
- The Hitchiker's Guide to PyTorch☆1,199Updated 4 years ago
- Reformer, the efficient Transformer, in Pytorch☆2,190Updated 2 years ago
- Pytorch Lightning code guideline for conferences☆1,280Updated 2 years ago
- Pytorch library for fast transformer implementations☆1,754Updated 2 years ago
- A repository containing tutorials for practical NLP using PyTorch☆537Updated 6 years ago
- Implementation of Transformer Model in Tensorflow☆476Updated 2 years ago
- PyTorch tutorials and best practices.☆1,702Updated 8 months ago
- An implementation of Performer, a linear attention-based transformer, in Pytorch☆1,166Updated 3 years ago
- PyTorch implementation of some attentions for Deep Learning Researchers.☆548Updated 3 years ago
- Long Range Arena for Benchmarking Efficient Transformers☆768Updated last year
- Original transformer paper: Implementation of Vaswani, Ashish, et al. "Attention is all you need." Advances in neural information process…☆241Updated last year
- PyTorch 101 series covering everything from the basic building blocks all the way to building custom architectures.☆265Updated 5 years ago
- A learning rate range test implementation in PyTorch☆992Updated 5 months ago
- FrancescoSaverioZuppichini / Pytorch-how-and-when-to-use-Module-Sequential-ModuleList-and-ModuleDictCode for my medium article☆373Updated 5 years ago
- Papers & presentation materials from Hugging Face's internal science day☆2,054Updated 5 years ago
- Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.☆271Updated last year
- A Visual Analysis Tool to Explore Learned Representations in Transformers Models☆602Updated last year
- 🔥 A collection of PyTorch notebooks for learning and practicing deep learning☆588Updated 2 years ago
- A pedagogical implementation of Autograd☆1,008Updated 5 years ago
- Build a Jekyll blog in minutes, without touching the command line.☆857Updated last month
- Shape and dimension inference (Keras-like) for PyTorch layers and neural networks☆573Updated 3 years ago
- Transformer seq2seq model, program that can build a language translator from parallel corpus☆1,420Updated 2 years ago
- Open source guides/codes for mastering deep learning to deploying deep learning in production in PyTorch, Python, Apptainer, and more.☆862Updated 3 months ago
- Hopfield Networks is All You Need☆1,880Updated 2 years ago
- Minimalist NMT for educational purposes☆708Updated last year
- The website for the CMU Language Technologies Institute low resource NLP bootcamp 2020☆604Updated 5 years ago