lucidrains / axial-attentionView external linksLinks
Implementation of Axial attention - attending to multi-dimensional data efficiently
☆397Aug 26, 2021Updated 4 years ago
Alternatives and similar repositories for axial-attention
Users that are interested in axial-attention are comparing it to the libraries listed below
Sorting:
- This is a PyTorch re-implementation of Axial-DeepLab (ECCV 2020 Spotlight)☆461Jun 22, 2021Updated 4 years ago
- Implementation of Invariant Point Attention, used for coordinate refinement in the structure module of Alphafold2, as a standalone Pytorc…☆171Nov 25, 2022Updated 3 years ago
- Locally Enhanced Self-Attention: Rethinking Self-Attention as Local and Context Terms☆11Nov 29, 2021Updated 4 years ago
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆49Jan 27, 2022Updated 4 years ago
- (ACL-IJCNLP 2021) Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models.☆21Jul 13, 2022Updated 3 years ago
- ☆20Nov 11, 2019Updated 6 years ago
- Code and models for the paper Glance-and-Gaze Vision Transformer☆28Jun 7, 2021Updated 4 years ago
- Axial Positional Embedding for Pytorch☆84Feb 25, 2025Updated 11 months ago
- ☆110Sep 15, 2021Updated 4 years ago
- An All-MLP solution for Vision, from Google AI☆1,057Jul 7, 2025Updated 7 months ago
- [ICLR'22 Oral] Implementation of "CycleMLP: A MLP-like Architecture for Dense Prediction"☆291Apr 25, 2022Updated 3 years ago
- Two simple and effective designs of vision transformer, which is on par with the Swin transformer☆608Feb 14, 2023Updated 3 years ago
- Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorc…☆310Dec 27, 2021Updated 4 years ago
- MLP-Like Vision Permutator for Visual Recognition (PyTorch)☆192Mar 31, 2022Updated 3 years ago
- LV-BERT: Exploiting Layer Variety for BERT (Findings of ACL 2021)☆18May 10, 2023Updated 2 years ago
- CCNet: Criss-Cross Attention for Semantic Segmentation (TPAMI 2020 & ICCV 2019).☆1,482Mar 19, 2021Updated 4 years ago
- Implementation of Linformer for Pytorch☆305Jan 5, 2024Updated 2 years ago
- ☆98Apr 27, 2022Updated 3 years ago
- A better PyTorch implementation of image local attention which reduces the GPU memory by an order of magnitude.☆142Dec 21, 2021Updated 4 years ago
- ☆246Jul 23, 2021Updated 4 years ago
- (ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"☆824Jul 14, 2022Updated 3 years ago
- ☆16May 6, 2021Updated 4 years ago
- Pytorch library for fast transformer implementations☆1,761Mar 23, 2023Updated 2 years ago
- Official implementation of PVT series☆1,882Oct 27, 2022Updated 3 years ago
- Revisiting Contrastive Methods for Unsupervised Learning of Visual Representations. [NeurIPS 2021]☆89Oct 2, 2021Updated 4 years ago
- ☆30Jan 17, 2022Updated 4 years ago
- CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped, CVPR 2022☆589Nov 1, 2023Updated 2 years ago
- Tensorflow implementation for "Improved Transformer for High-Resolution GANs" (NeurIPS 2021).☆93Jul 30, 2024Updated last year
- implementing Weight Agnostic Neural Networks to Spiking Neural Networks☆10Jan 26, 2021Updated 5 years ago
- Refactoring dalle-pytorch and taming-transformers for TPU VM☆60Aug 30, 2021Updated 4 years ago
- A simple to use pytorch wrapper for contrastive self-supervised learning on any neural network☆150Mar 12, 2021Updated 4 years ago
- A simple implementation of a deep linear Pytorch module☆21Oct 16, 2020Updated 5 years ago
- A convolution-free, transformer-only version of the CycleGAN framework☆33Feb 12, 2022Updated 4 years ago
- Official code Cross-Covariance Image Transformer (XCiT)☆674Sep 28, 2021Updated 4 years ago
- The correct way to resize images or tensors. For Numpy or Pytorch (differentiable).☆562Jul 13, 2023Updated 2 years ago
- Accelerating T2t-ViT by 1.6-3.6x.☆258Nov 25, 2021Updated 4 years ago
- Neighborhood Attention Transformer, arxiv 2022 / CVPR 2023. Dilated Neighborhood Attention Transformer, arxiv 2022☆1,175May 15, 2024Updated last year
- PyTorch Codes for Haar Graph Pooling☆11Feb 16, 2023Updated 3 years ago
- Official Pytorch Implementation for the paper 'SUPER-ADAM: Faster and Universal Framework of Adaptive Gradients'☆17Jan 12, 2022Updated 4 years ago