pbloem / formerLinks
Simple transformer implementation from scratch in pytorch. (archival, latest version on codeberg)
☆1,089Updated 6 months ago
Alternatives and similar repositories for former
Users that are interested in former are comparing it to the libraries listed below
Sorting:
- My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing o…☆1,055Updated 4 years ago
- A collection of resources to study Transformers in depth.☆548Updated last year
- PyTorch tutorials and best practices.☆1,696Updated 6 months ago
- ☆818Updated 5 months ago
- Reformer, the efficient Transformer, in Pytorch☆2,181Updated 2 years ago
- Hopfield Networks is All You Need☆1,854Updated 2 years ago
- Pytorch library for fast transformer implementations☆1,737Updated 2 years ago
- Fast, general, and tested differentiable structured prediction in PyTorch☆1,115Updated 3 years ago
- Pytorch Lightning code guideline for conferences☆1,279Updated 2 years ago
- Transformer seq2seq model, program that can build a language translator from parallel corpus☆1,409Updated 2 years ago
- Longformer: The Long-Document Transformer☆2,167Updated 2 years ago
- PyTorch implementation of some attentions for Deep Learning Researchers.☆544Updated 3 years ago
- Long Range Arena for Benchmarking Efficient Transformers☆764Updated last year
- The Hitchiker's Guide to PyTorch☆1,198Updated 4 years ago
- Toolbox of models, callbacks, and datasets for AI/ML researchers.☆1,740Updated last month
- 🔥 A collection of PyTorch notebooks for learning and practicing deep learning☆582Updated 2 years ago
- Papers & presentation materials from Hugging Face's internal science day☆2,050Updated 4 years ago
- FrancescoSaverioZuppichini / Pytorch-how-and-when-to-use-Module-Sequential-ModuleList-and-ModuleDictCode for my medium article☆372Updated 5 years ago
- The goal of this library is to generate more helpful exception messages for matrix algebra expressions for numpy, pytorch, jax, tensorflo…☆811Updated 3 years ago
- Course notes☆721Updated last year
- A Visual Analysis Tool to Explore Learned Representations in Transformers Models☆599Updated last year
- A repository containing tutorials for practical NLP using PyTorch☆538Updated 6 years ago
- The website for the CMU Language Technologies Institute low resource NLP bootcamp 2020☆602Updated 5 years ago
- A learning rate range test implementation in PyTorch☆984Updated 3 months ago
- Cramming the training of a (BERT-type) language model into limited compute.☆1,349Updated last year
- An implementation of Performer, a linear attention-based transformer, in Pytorch☆1,148Updated 3 years ago
- Transformer based on a variant of attention that is linear complexity in respect to sequence length☆798Updated last year
- Learn how to use PyTorch to solve some common NLP problems with deep learning.☆420Updated 5 years ago
- Implementation of the first paper on word2vec☆242Updated 3 years ago
- Build a Jekyll blog in minutes, without touching the command line.☆853Updated 6 months ago