pbloem / formerLinks
Simple transformer implementation from scratch in pytorch. (archival, latest version on codeberg)
☆1,093Updated 9 months ago
Alternatives and similar repositories for former
Users that are interested in former are comparing it to the libraries listed below
Sorting:
- My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing o…☆1,078Updated 5 years ago
- A collection of resources to study Transformers in depth.☆561Updated 2 years ago
- ☆827Updated 8 months ago
- Fast, general, and tested differentiable structured prediction in PyTorch☆1,123Updated 3 years ago
- Hopfield Networks is All You Need☆1,890Updated 2 years ago
- FrancescoSaverioZuppichini / Pytorch-how-and-when-to-use-Module-Sequential-ModuleList-and-ModuleDictCode for my medium article☆375Updated 5 years ago
- PyTorch tutorials and best practices.☆1,703Updated 9 months ago
- PyTorch implementation of some attentions for Deep Learning Researchers.☆548Updated 3 years ago
- Course notes☆737Updated last year
- The Hitchiker's Guide to PyTorch☆1,199Updated 4 years ago
- A walkthrough of transformer architecture code☆371Updated last year
- PyTorch 101 series covering everything from the basic building blocks all the way to building custom architectures.☆265Updated 5 years ago
- Reformer, the efficient Transformer, in Pytorch☆2,191Updated 2 years ago
- Visualize Tensorflow's optimizers.☆398Updated 7 years ago
- A repository containing tutorials for practical NLP using PyTorch☆537Updated 6 years ago
- Pytorch library for fast transformer implementations☆1,755Updated 2 years ago
- The goal of this library is to generate more helpful exception messages for matrix algebra expressions for numpy, pytorch, jax, tensorflo…☆812Updated 3 years ago
- Reproducing Yann LeCun 1989 paper "Backpropagation Applied to Handwritten Zip Code Recognition", to my knowledge the earliest real-world …☆701Updated last year
- An implementation of Performer, a linear attention-based transformer, in Pytorch☆1,170Updated 3 years ago
- 🔥 A collection of PyTorch notebooks for learning and practicing deep learning☆589Updated 2 years ago
- Single Headed Attention RNN - "Stop thinking with your head"☆1,181Updated 4 years ago
- Open source guides/codes for mastering deep learning to deploying deep learning in production in PyTorch, Python, Apptainer, and more.☆863Updated 3 months ago
- Attention Is All You Need | a PyTorch Tutorial to Transformers☆359Updated last year
- A pedagogical implementation of Autograd☆1,010Updated 5 years ago
- Original transformer paper: Implementation of Vaswani, Ashish, et al. "Attention is all you need." Advances in neural information process…☆241Updated last year
- Pytorch Lightning code guideline for conferences☆1,284Updated 2 years ago
- Notebooks and various random fun☆1,134Updated 2 years ago
- Cramming the training of a (BERT-type) language model into limited compute.☆1,355Updated last year
- Implementation of Transformer Model in Tensorflow☆479Updated 2 years ago
- Summaries for exciting works in the field of Deep Learning.☆356Updated 7 months ago