lucidrains / perceiver-pytorch
Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch
☆1,120Updated last year
Alternatives and similar repositories for perceiver-pytorch:
Users that are interested in perceiver-pytorch are comparing it to the libraries listed below
- Transformer based on a variant of attention that is linear complexity in respect to sequence length☆738Updated 9 months ago
- A PyTorch implementation of Perceiver, Perceiver IO and Perceiver AR with PyTorch Lightning scripts for distributed training☆452Updated last year
- An implementation of Performer, a linear attention-based transformer, in Pytorch☆1,115Updated 3 years ago
- Pytorch library for fast transformer implementations☆1,677Updated last year
- Implementation of ConvMixer for "Patches Are All You Need? 🤷"☆1,064Updated 2 years ago
- An All-MLP solution for Vision, from Google AI☆1,013Updated 5 months ago
- Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in Pytorch☆1,795Updated 7 months ago
- Implementation of Slot Attention from GoogleAI☆410Updated 6 months ago
- (ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"☆809Updated 2 years ago
- Neighborhood Attention Transformer, arxiv 2022 / CVPR 2023. Dilated Neighborhood Attention Transformer, arxiv 2022☆1,088Updated 9 months ago
- An implementation of 1D, 2D, and 3D positional encoding in Pytorch and TensorFlow☆564Updated 3 months ago
- MultiMAE: Multi-modal Multi-task Masked Autoencoders, ECCV 2022☆562Updated 2 years ago
- A simple way to keep track of an Exponential Moving Average (EMA) version of your Pytorch model☆559Updated 2 months ago
- Fast, differentiable sorting and ranking in PyTorch☆792Updated last year
- PyTorch implementation of MoCo v3 https//arxiv.org/abs/2104.02057☆1,242Updated 3 years ago
- VQVAEs, GumbelSoftmaxes and friends☆553Updated 3 years ago
- Reformer, the efficient Transformer, in Pytorch☆2,152Updated last year
- Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models☆774Updated 7 months ago
- PyTorch implementation of Barlow Twins.☆967Updated 2 years ago
- Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch☆635Updated 2 months ago
- [CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize …☆1,840Updated last year
- A Pytorch-Lightning implementation of self-supervised algorithms☆537Updated 2 years ago
- Implementation of Axial attention - attending to multi-dimensional data efficiently☆371Updated 3 years ago
- PyTorch implementation of SwAV https//arxiv.org/abs/2006.09882☆2,024Updated last year
- An implementation of local windowed attention for language modeling☆420Updated last month
- PyTorch implementation of SimSiam https//arxiv.org/abs/2011.10566☆1,175Updated 2 years ago
- VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.☆3,266Updated 11 months ago
- iBOT : Image BERT Pre-Training with Online Tokenizer (ICLR 2022)☆705Updated 2 years ago
- Fully featured implementation of Routing Transformer☆288Updated 3 years ago
- Implementation of Linformer for Pytorch☆266Updated last year