lucidrains / global-self-attention-networkLinks
A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks
☆95Updated 4 years ago
Alternatives and similar repositories for global-self-attention-network
Users that are interested in global-self-attention-network are comparing it to the libraries listed below
Sorting:
- PyTorch reimplementation of the paper "Involution: Inverting the Inherence of Convolution for Visual Recognition" (2D and 3D Involution) …☆105Updated 3 years ago
- Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones☆199Updated 4 years ago
- AReLU: Attention-based-Rectified-Linear-Unit☆62Updated 3 years ago
- Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"☆99Updated 4 years ago
- MLP-Like Vision Permutator for Visual Recognition (PyTorch)☆191Updated 3 years ago
- Dynamic Group Convolution for Accelerating Convolutional Neural Networks (ECCV 2020)☆127Updated 4 years ago
- [Preprint] ConvMLP: Hierarchical Convolutional MLPs for Vision, 2021☆167Updated 2 years ago
- ULSAM: Ultra-Lightweight Subspace Attention Module for Compact Convolutional Neural Networks☆82Updated 4 years ago
- Unofficial PyTorch reimplemention of the paper "Involution: Inverting the Inherence of Convolution for Visual Recognition" [CVPR 2021].☆21Updated 4 years ago
- (CVPR-Oral 2021) PyTorch implementation of Knowledge Evolution approach and Split-Nets☆83Updated 3 years ago
- Attention mechanism☆53Updated 3 years ago
- ☆57Updated 3 years ago
- Gated Channel Transformation for Visual Recognition (CVPR 2020)☆134Updated 5 years ago
- Implementation of Uformer, Attention-based Unet, in Pytorch☆95Updated 3 years ago
- The official implementation of paper "Instance Enhancement Batch Normalization: an Adaptive Regulator of Batch Noise".☆40Updated 2 years ago
- Implementation of Convolutional enhanced image Transformer☆105Updated 4 years ago
- PyTorch Implementation of CvT: Introducing Convolutions to Vision Transformers☆226Updated 4 years ago
- PyTorch implementation of MLP-Mixer☆37Updated 4 years ago
- Implementation for our paper exploring a novel 2D adaptive attention span kernel in computer vision.☆35Updated last year
- ☆134Updated 2 years ago
- code and trained models for "Attention as Activation"☆19Updated 5 years ago
- [WACV 2022] "Sandwich Batch Normalization: A Drop-In Replacement for Feature Distribution Heterogeneity" by Xinyu Gong, Wuyang Chen, Tian…☆51Updated 3 years ago
- unofficial implementation of CondConv: Conditionally Parameterized Convolutions for Efficient Inference in PyTorch.☆160Updated last year
- Implementation of various Vision Transformers I found interesting☆84Updated 4 years ago
- This repo contains the code of "ConTNet: Why not use convolution and transformer at the same time?"☆99Updated 4 years ago
- ☆26Updated 4 years ago
- Unofficial PyTorch implementation of "Filter Response Normalization Layer: Eliminating Batch Dependence in the Training of Deep Neural Ne…☆22Updated 5 years ago
- SoT: Delving Deeper into Classification Head for Transformer☆49Updated 3 years ago
- Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorc…☆305Updated 3 years ago
- Implementation for Context-Gated Convolution☆59Updated 3 years ago