pbloem / former
Simple transformer implementation from scratch in pytorch.
☆1,053Updated 6 months ago
Related projects ⓘ
Alternatives and complementary repositories for former
- My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing o…☆995Updated 3 years ago
- Pytorch library for fast transformer implementations☆1,644Updated last year
- Course notes☆624Updated 7 months ago
- ☆766Updated 8 months ago
- A concise but complete full-attention transformer with a set of promising experimental features from various papers☆4,804Updated this week
- Reformer, the efficient Transformer, in Pytorch☆2,125Updated last year
- Toolbox of models, callbacks, and datasets for AI/ML researchers.☆1,696Updated 2 weeks ago
- Longformer: The Long-Document Transformer☆2,048Updated last year
- An implementation of Performer, a linear attention-based transformer, in Pytorch☆1,098Updated 2 years ago
- An unofficial styleguide and best practices summary for PyTorch☆1,931Updated 2 years ago
- Cramming the training of a (BERT-type) language model into limited compute.☆1,296Updated 5 months ago
- Pytorch Lightning code guideline for conferences☆1,240Updated last year
- PyTorch implementation of some attentions for Deep Learning Researchers.☆516Updated 2 years ago
- A Unified Library for Parameter-Efficient and Modular Transfer Learning☆2,582Updated 3 weeks ago
- Hopfield Networks is All You Need☆1,731Updated last year
- Fast, general, and tested differentiable structured prediction in PyTorch☆1,106Updated 2 years ago
- Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"☆1,525Updated 4 years ago
- A repository containing tutorials for practical NLP using PyTorch☆530Updated 5 years ago
- A collection of resources to study Transformers in depth.☆511Updated 11 months ago
- An annotated implementation of the Transformer paper.☆5,740Updated 7 months ago
- A pedagogical implementation of Autograd☆955Updated 4 years ago
- PyTorch tutorials and best practices.☆1,657Updated 2 years ago
- torch-optimizer -- collection of optimizers for Pytorch☆3,044Updated 8 months ago
- Long Range Arena for Benchmarking Efficient Transformers☆731Updated 11 months ago
- Enabling PyTorch on XLA Devices (e.g. Google TPU)☆2,490Updated this week
- Repository of Jupyter notebook tutorials for teaching the Deep Learning Course at the University of Amsterdam (MSc AI), Fall 2023☆2,582Updated 3 weeks ago
- PyTorch extensions for high performance and large scale training.☆3,199Updated last week
- BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)☆6,962Updated last year
- View model summaries in PyTorch!☆2,604Updated this week
- 🐥A PyTorch implementation of OpenAI's finetuned transformer language model with a script to import the weights pre-trained by OpenAI☆1,511Updated 3 years ago