lironui / Linear-Attention-MechanismLinks
Attention mechanism
☆53Updated 3 years ago
Alternatives and similar repositories for Linear-Attention-Mechanism
Users that are interested in Linear-Attention-Mechanism are comparing it to the libraries listed below
Sorting:
- [ICLR'22] This is an official implementation for "AS-MLP: An Axial Shifted MLP Architecture for Vision".☆126Updated 2 years ago
- PointFlow (CVPR-2021)☆123Updated last year
- A PyTorch implementation of CMT based on paper CMT: Convolutional Neural Networks Meet Vision Transformers.☆70Updated 2 years ago
- Implementation of Convolutional enhanced image Transformer☆104Updated 4 years ago
- iclr2024 poster Varying Window Attention☆125Updated 7 months ago
- Official implementation of the paper ``Unifying Nonlocal Blocks for Neural Networks'' (ICCV'21)☆98Updated 3 years ago
- ☆20Updated 4 years ago
- Codes of "SPANet: Spatial Pyramid Attention Network for Enhanced Image Recognition"☆26Updated 5 years ago
- ☆119Updated 3 years ago
- ☆190Updated 2 years ago
- Warmup learning rate wrapper for Pytorch Scheduler☆41Updated 5 years ago
- Implementation of Swin Transformer with Pytorch☆112Updated 4 years ago
- [AAAI 2021] Pytorch implementation for "Tied Block Convolution: Leaner and Better CNNs with Shared Thinner Filters."☆37Updated 4 years ago
- Vision Transformers with Hierarchical Attention☆101Updated 8 months ago
- A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks☆95Updated 4 years ago
- Implementation of Hire-MLP: Vision MLP via Hierarchical Rearrangement and An Image Patch is a Wave: Phase-Aware Vision MLP.☆37Updated 2 years ago
- This is an official implementation for "ResT: An Efficient Transformer for Visual Recognition".☆285Updated 2 years ago
- Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)☆76Updated 4 years ago
- [T-IP 2023] Code for exponential adaptive pooling for PyTorch☆82Updated 2 years ago
- Unofficial Implementation of MLP-Mixer, gMLP, resMLP, Vision Permutator, S2MLP, S2MLPv2, RaftMLP, HireMLP, ConvMLP, AS-MLP, SparseMLP, Co…☆169Updated 2 years ago
- PyTorch implementation of "MLP-Mixer: An all-MLP Architecture for Vision" Tolstikhin et al. (2021)☆30Updated 4 years ago
- Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers☆196Updated 4 years ago
- Implementation of SETR model, Original paper: Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers.☆132Updated 4 years ago
- A way to use superpixels at run-time with Pytorch☆33Updated last year
- [ICLR'22 Oral] Implementation of "CycleMLP: A MLP-like Architecture for Dense Prediction"☆288Updated 3 years ago
- Official implement of "CAT: Cross Attention in Vision Transformer".☆160Updated 2 years ago
- Numpy/Python implementation of DenseCRF☆23Updated 2 years ago
- Simple implementation of Mobile-Former on Pytorch☆108Updated 3 years ago
- Lite Vision Transformer (CVPR 2022)☆143Updated 2 years ago
- MobileFormer in torch☆66Updated 3 years ago