lucidrains / global-self-attention-networkLinks
A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks
β95Updated 4 years ago
Alternatives and similar repositories for global-self-attention-network
Users that are interested in global-self-attention-network are comparing it to the libraries listed below
Sorting:
- MLP-Like Vision Permutator for Visual Recognition (PyTorch)β192Updated 3 years ago
- Implementation of the π Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbonesβ200Updated 4 years ago
- PyTorch reimplementation of the paper "Involution: Inverting the Inherence of Convolution for Visual Recognition" (2D and 3D Involution) β¦β105Updated 3 years ago
- Attention mechanismβ52Updated 4 years ago
- β58Updated 3 years ago
- Implementation of various Vision Transformers I found interestingβ84Updated 4 years ago
- Implementation of Convolutional enhanced image Transformerβ105Updated 4 years ago
- [WACV 2022] "Sandwich Batch Normalization: A Drop-In Replacement for Feature Distribution Heterogeneity" by Xinyu Gong, Wuyang Chen, Tianβ¦β51Updated 3 years ago
- Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"β99Updated 4 years ago
- β135Updated 2 years ago
- Locally Enhanced Self-Attention: Rethinking Self-Attention as Local and Context Termsβ20Updated 3 years ago
- [Preprint] ConvMLP: Hierarchical Convolutional MLPs for Vision, 2021β167Updated 3 years ago
- AReLU: Attention-based-Rectified-Linear-Unitβ62Updated 4 years ago
- Dynamic Group Convolution for Accelerating Convolutional Neural Networks (ECCV 2020)β127Updated 4 years ago
- Gated Channel Transformation for Visual Recognition (CVPR 2020)β135Updated 5 years ago
- ULSAM: Ultra-Lightweight Subspace Attention Module for Compact Convolutional Neural Networksβ83Updated 4 years ago
- PyTorch Implementation of CvT: Introducing Convolutions to Vision Transformersβ228Updated 4 years ago
- Unofficial PyTorch implementation of "Filter Response Normalization Layer: Eliminating Batch Dependence in the Training of Deep Neural Neβ¦β22Updated 5 years ago
- (CVPR-Oral 2021) PyTorch implementation of Knowledge Evolution approach and Split-Netsβ83Updated 4 years ago
- This repo contains the code of "ConTNet: Why not use convolution and transformer at the same time?"β99Updated 4 years ago
- Implementing Lambda Networks using Pytorchβ140Updated 4 years ago
- PyTorch implementation of MLP-Mixerβ37Updated 4 years ago
- Unofficial implementation of MLP-Mixer: An all-MLP Architecture for Visionβ218Updated 4 years ago
- Implementation for Context-Gated Convolutionβ60Updated 3 years ago
- code and trained models for "Attention as Activation"β19Updated 5 years ago
- Implementation of Uniformer, a simple attention and 3d convolutional net that achieved SOTA in a number of video classification tasks, deβ¦β102Updated 3 years ago
- Channelized Axial Attention for Semantic Segmentation (AAAI-2022)β31Updated 3 years ago
- Recent Advances in MLP-based Models (MLP is all you need!)β117Updated 2 years ago
- Official Repsoitory for "Activate or Not: Learning Customized Activation." [CVPR 2021]β207Updated 4 years ago
- Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)β75Updated 5 years ago