lucidrains / global-self-attention-networkLinks
A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks
☆95Updated 4 years ago
Alternatives and similar repositories for global-self-attention-network
Users that are interested in global-self-attention-network are comparing it to the libraries listed below
Sorting:
- MLP-Like Vision Permutator for Visual Recognition (PyTorch)☆192Updated 3 years ago
- Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones☆200Updated 4 years ago
- PyTorch reimplementation of the paper "Involution: Inverting the Inherence of Convolution for Visual Recognition" (2D and 3D Involution) …☆105Updated 3 years ago
- Attention mechanism☆52Updated 4 years ago
- ☆58Updated 3 years ago
- Implementation of various Vision Transformers I found interesting☆84Updated 4 years ago
- Implementation of Convolutional enhanced image Transformer☆105Updated 4 years ago
- [WACV 2022] "Sandwich Batch Normalization: A Drop-In Replacement for Feature Distribution Heterogeneity" by Xinyu Gong, Wuyang Chen, Tian…☆51Updated 3 years ago
- Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"☆99Updated 4 years ago
- ☆135Updated 2 years ago
- Locally Enhanced Self-Attention: Rethinking Self-Attention as Local and Context Terms☆20Updated 3 years ago
- [Preprint] ConvMLP: Hierarchical Convolutional MLPs for Vision, 2021☆167Updated 3 years ago
- AReLU: Attention-based-Rectified-Linear-Unit☆62Updated 4 years ago
- Dynamic Group Convolution for Accelerating Convolutional Neural Networks (ECCV 2020)☆127Updated 4 years ago
- Gated Channel Transformation for Visual Recognition (CVPR 2020)☆135Updated 5 years ago
- ULSAM: Ultra-Lightweight Subspace Attention Module for Compact Convolutional Neural Networks☆83Updated 4 years ago
- PyTorch Implementation of CvT: Introducing Convolutions to Vision Transformers☆228Updated 4 years ago
- Unofficial PyTorch implementation of "Filter Response Normalization Layer: Eliminating Batch Dependence in the Training of Deep Neural Ne…☆22Updated 5 years ago
- (CVPR-Oral 2021) PyTorch implementation of Knowledge Evolution approach and Split-Nets☆83Updated 4 years ago
- This repo contains the code of "ConTNet: Why not use convolution and transformer at the same time?"☆99Updated 4 years ago
- Implementing Lambda Networks using Pytorch☆140Updated 4 years ago
- PyTorch implementation of MLP-Mixer☆37Updated 4 years ago
- Unofficial implementation of MLP-Mixer: An all-MLP Architecture for Vision☆218Updated 4 years ago
- Implementation for Context-Gated Convolution☆60Updated 3 years ago
- code and trained models for "Attention as Activation"☆19Updated 5 years ago
- Implementation of Uniformer, a simple attention and 3d convolutional net that achieved SOTA in a number of video classification tasks, de…☆102Updated 3 years ago
- Channelized Axial Attention for Semantic Segmentation (AAAI-2022)☆31Updated 3 years ago
- Recent Advances in MLP-based Models (MLP is all you need!)☆117Updated 2 years ago
- Official Repsoitory for "Activate or Not: Learning Customized Activation." [CVPR 2021]☆207Updated 4 years ago
- Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)☆75Updated 5 years ago