gordicaleksa / pytorch-original-transformer
My implementation of the original transformer model (Vaswani et al.). I've additionally included the playground.py file for visualizing otherwise seemingly hard concepts. Currently included IWSLT pretrained models.
☆991Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for pytorch-original-transformer
- Simple transformer implementation from scratch in pytorch.☆1,052Updated 6 months ago
- Pytorch Lightning code guideline for conferences☆1,242Updated last year
- A library to inspect and extract intermediate layers of PyTorch models.☆470Updated 2 years ago
- Pytorch library for fast transformer implementations☆1,643Updated last year
- Reformer, the efficient Transformer, in Pytorch☆2,121Updated last year
- Flexible components pairing 🤗 Transformers with Pytorch Lightning☆611Updated last year
- Transformer based on a variant of attention that is linear complexity in respect to sequence length☆698Updated 6 months ago
- PyTorch 101 series covering everything from the basic building blocks all the way to building custom architectures.☆253Updated 4 years ago
- Generic template to bootstrap your PyTorch project.☆635Updated last year
- Paper implementations from scratch and machine learning tutorials☆341Updated 10 months ago
- Toolbox of models, callbacks, and datasets for AI/ML researchers.☆1,695Updated 2 weeks ago
- Longformer: The Long-Document Transformer☆2,047Updated last year
- An implementation of Performer, a linear attention-based transformer, in Pytorch☆1,098Updated 2 years ago
- PyTorch implementation of some attentions for Deep Learning Researchers.☆513Updated 2 years ago
- An unofficial styleguide and best practices summary for PyTorch☆1,931Updated 2 years ago
- Tez is a super-simple and lightweight Trainer for PyTorch. It also comes with many utils that you can use to tackle over 90% of deep lear…☆1,163Updated last year
- The purpose of this repo is to make it easy to get started with JAX, Flax, and Haiku. It contains my "Machine Learning with JAX" series o…☆661Updated 11 months ago
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.☆1,134Updated this week
- torchview: visualize pytorch models☆831Updated 3 weeks ago
- Library for 8-bit optimizers and quantization routines.☆714Updated 2 years ago
- Complete deep learning project developed in Full Stack Deep Learning, Spring 2021☆450Updated 3 years ago
- Build, train, deploy, scale and maintain deep learning models. Understand ML infrastructure and MLOps using hands-on examples.☆1,111Updated last year
- 🧠 A study guide to learn about Transformers☆1,541Updated last year
- ML Collections is a library of Python Collections designed for ML use cases.☆896Updated this week
- ☆766Updated 8 months ago
- ☆343Updated 3 years ago
- VQVAEs, GumbelSoftmaxes and friends☆535Updated 3 years ago
- Your PyTorch AI Factory - Flash enables you to easily configure and run complex AI recipes for over 15 tasks across 7 data domains☆1,743Updated last year
- A concise but complete full-attention transformer with a set of promising experimental features from various papers☆4,793Updated this week
- This is a collection of the code that accompanies the reports in The Gallery by Weights & Biases.☆327Updated 2 years ago