pbloem / formerLinks
Simple transformer implementation from scratch in pytorch. (archival, latest version on codeberg)
☆1,089Updated 7 months ago
Alternatives and similar repositories for former
Users that are interested in former are comparing it to the libraries listed below
Sorting:
- A collection of resources to study Transformers in depth.☆552Updated last year
- My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing o…☆1,064Updated 4 years ago
- ☆821Updated 6 months ago
- Fast, general, and tested differentiable structured prediction in PyTorch☆1,117Updated 3 years ago
- Hopfield Networks is All You Need☆1,861Updated 2 years ago
- PyTorch 101 series covering everything from the basic building blocks all the way to building custom architectures.☆265Updated 5 years ago
- PyTorch implementation of some attentions for Deep Learning Researchers.☆547Updated 3 years ago
- Summaries for exciting works in the field of Deep Learning.☆354Updated 5 months ago
- Reformer, the efficient Transformer, in Pytorch☆2,181Updated 2 years ago
- Pytorch library for fast transformer implementations☆1,745Updated 2 years ago
- Attention Is All You Need | a PyTorch Tutorial to Transformers☆351Updated last year
- PyTorch tutorials and best practices.☆1,699Updated 7 months ago
- A repository containing tutorials for practical NLP using PyTorch☆538Updated 6 years ago
- Implementation of Transformer Model in Tensorflow☆476Updated 2 years ago
- The website for the CMU Language Technologies Institute low resource NLP bootcamp 2020☆603Updated 5 years ago
- Papers & presentation materials from Hugging Face's internal science day☆2,051Updated 4 years ago
- Course notes☆726Updated last year
- Pytorch Lightning code guideline for conferences☆1,280Updated 2 years ago
- FrancescoSaverioZuppichini / Pytorch-how-and-when-to-use-Module-Sequential-ModuleList-and-ModuleDictCode for my medium article☆373Updated 5 years ago
- An implementation of Performer, a linear attention-based transformer, in Pytorch☆1,154Updated 3 years ago
- Long Range Arena for Benchmarking Efficient Transformers☆767Updated last year
- jiant is an nlp toolkit☆1,671Updated 2 years ago
- 🔥 A collection of PyTorch notebooks for learning and practicing deep learning☆583Updated 2 years ago
- Longformer: The Long-Document Transformer☆2,171Updated 2 years ago
- Annotations of the interesting ML papers I read☆261Updated 2 weeks ago
- Cramming the training of a (BERT-type) language model into limited compute.☆1,349Updated last year
- A walkthrough of transformer architecture code☆369Updated last year
- Original transformer paper: Implementation of Vaswani, Ashish, et al. "Attention is all you need." Advances in neural information process…☆240Updated last year
- Transformer training code for sequential tasks☆610Updated 4 years ago
- The Hitchiker's Guide to PyTorch☆1,197Updated 4 years ago