teddykoker / image-gpt
PyTorch Implementation of OpenAI's Image GPT
☆254Updated 11 months ago
Related projects: ⓘ
- Fully featured implementation of Routing Transformer☆283Updated 2 years ago
- VQVAEs, GumbelSoftmaxes and friends☆521Updated 2 years ago
- Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).☆221Updated 2 years ago
- Implementation of Feedback Transformer in Pytorch☆103Updated 3 years ago
- Repository for the paper "Very Deep VAEs Generalize Autoregressive Models and Can Outperform Them on Images"☆434Updated last year
- Implementation of Linformer for Pytorch☆244Updated 8 months ago
- An attempt at the implementation of Glom, Geoffrey Hinton's new idea that integrates concepts from neural fields, top-down-bottom-up proc…☆190Updated 3 years ago
- Pytorch implementation of Compressive Transformers, from Deepmind☆154Updated 2 years ago
- Tiny PyTorch library for maintaining a moving average of a collection of parameters.☆400Updated 2 years ago
- Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention☆252Updated 3 years ago
- Implementation of https://arxiv.org/abs/1904.00962☆366Updated 3 years ago
- Official codebase for Pretrained Transformers as Universal Computation Engines.☆244Updated 2 years ago
- Memory Efficient Attention (O(sqrt(n)) for Jax and PyTorch☆178Updated last year
- Unofficial PyTorch implementation of Attention Free Transformer (AFT) layers by Apple Inc.☆226Updated 2 years ago
- Is the attention layer even necessary? (https://arxiv.org/abs/2105.02723)☆480Updated 3 years ago
- [CVPR 2021] VirTex: Learning Visual Representations from Textual Annotations☆556Updated 8 months ago
- Code for the paper, "Distribution Augmentation for Generative Modeling", ICML 2020.☆121Updated last year
- A concise but complete implementation of CLIP with various experimental improvements from recent papers☆678Updated 11 months ago
- Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms☆249Updated 3 years ago
- Understanding the Difficulty of Training Transformers☆325Updated 2 years ago
- Pre-trained NFNets with 99% of the accuracy of the official paper "High-Performance Large-Scale Image Recognition Without Normalization".☆159Updated 3 years ago
- Implementation of Fast Transformer in Pytorch☆171Updated 3 years ago
- Implementation of fused cosine similarity attention in the same style as Flash Attention☆204Updated last year
- A simple to use pytorch wrapper for contrastive self-supervised learning on any neural network☆119Updated 3 years ago
- ☆360Updated 11 months ago
- Implementation of popular SOTA self-supervised learning algorithms as Fastai Callbacks.☆318Updated last year
- Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload☆123Updated 2 years ago
- My take on a practical implementation of Linformer for Pytorch.☆403Updated 2 years ago
- DeLighT: Very Deep and Light-Weight Transformers☆465Updated 3 years ago
- Transformer based on a variant of attention that is linear complexity in respect to sequence length☆672Updated 4 months ago