pbloem / formerLinks
Simple transformer implementation from scratch in pytorch. (archival, latest version on codeberg)
☆1,086Updated 3 months ago
Alternatives and similar repositories for former
Users that are interested in former are comparing it to the libraries listed below
Sorting:
- My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing o…☆1,032Updated 4 years ago
- A collection of resources to study Transformers in depth.☆540Updated last year
- Reformer, the efficient Transformer, in Pytorch☆2,174Updated 2 years ago
- Pytorch library for fast transformer implementations☆1,723Updated 2 years ago
- Fast, general, and tested differentiable structured prediction in PyTorch☆1,114Updated 3 years ago
- ☆808Updated 3 months ago
- Course notes☆695Updated last year
- Long Range Arena for Benchmarking Efficient Transformers☆759Updated last year
- PyTorch implementation of some attentions for Deep Learning Researchers.☆534Updated 3 years ago
- Implementation of Transformer Model in Tensorflow☆470Updated 2 years ago
- FrancescoSaverioZuppichini / Pytorch-how-and-when-to-use-Module-Sequential-ModuleList-and-ModuleDictCode for my medium article☆371Updated 4 years ago
- Hopfield Networks is All You Need☆1,814Updated 2 years ago
- An implementation of Performer, a linear attention-based transformer, in Pytorch☆1,136Updated 3 years ago
- A repository containing tutorials for practical NLP using PyTorch☆537Updated 5 years ago
- PyTorch tutorials and best practices.☆1,689Updated 3 months ago
- Longformer: The Long-Document Transformer☆2,145Updated 2 years ago
- Cramming the training of a (BERT-type) language model into limited compute.☆1,338Updated last year
- Transformer based on a variant of attention that is linear complexity in respect to sequence length☆784Updated last year
- FastFormers - highly efficient transformer models for NLU☆705Updated 3 months ago
- Pytorch Lightning code guideline for conferences☆1,271Updated last year
- Transformers for Longer Sequences☆617Updated 2 years ago
- The Hitchiker's Guide to PyTorch☆1,198Updated 3 years ago
- Flexible components pairing 🤗 Transformers with Pytorch Lightning☆609Updated 2 years ago
- PyTorch 101 series covering everything from the basic building blocks all the way to building custom architectures.☆263Updated 4 years ago
- Transformer seq2seq model, program that can build a language translator from parallel corpus☆1,401Updated 2 years ago
- A Visual Analysis Tool to Explore Learned Representations in Transformers Models☆596Updated last year
- Summaries for exciting works in the field of Deep Learning.☆352Updated last month
- Github repo with tutorials to fine tune transformers for diff NLP tasks☆857Updated last year
- The website for the CMU Language Technologies Institute low resource NLP bootcamp 2020☆601Updated 5 years ago
- Model explainability that works seamlessly with 🤗 transformers. Explain your transformers model in just 2 lines of code.☆1,356Updated last year