Alternatives and similar repositories for Linear-Attention-Mechanism

Users that are interested in Linear-Attention-Mechanism are comparing it to the libraries listed below

• SHI-Labs / Convolutional-MLPs
  [Preprint] ConvMLP: Hierarchical Convolutional MLPs for Vision, 2021
  ☆167Updated 2 years ago
• svip-lab / AS-MLP
  [ICLR'22] This is an official implementation for "AS-MLP: An Axial Shifted MLP Architecture for Vision".
  ☆126Updated 2 years ago
• lucidrains / global-self-attention-network
  A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks
  ☆95Updated 4 years ago
• microsoft / SPACH
  ☆201Updated last year
• yan-hao-tian / VW
  iclr2024 poster Varying Window Attention
  ☆128Updated 11 months ago
• rishikksh20 / CeiT-pytorch
  Implementation of Convolutional enhanced image Transformer
  ☆105Updated 4 years ago
• frank-xwang / TBC-TiedBlockConvolution
  [AAAI 2021] Pytorch implementation for "Tied Block Convolution: Leaner and Better CNNs with Shared Thinner Filters."
  ☆37Updated 4 years ago
• wilile26811249 / CMT_CNN-meet-Vision-Transformer
  A PyTorch implementation of CMT based on paper CMT: Convolutional Neural Networks Meet Vision Transformers.
  ☆71Updated 2 years ago
• liuruiyang98 / Jittor-MLP
  Unofficial Implementation of MLP-Mixer, gMLP, resMLP, Vision Permutator, S2MLP, S2MLPv2, RaftMLP, HireMLP, ConvMLP, AS-MLP, SparseMLP, Co…
  ☆169Updated 3 years ago
• jiaozizhao / LiftPool
  ☆20Updated 4 years ago
• okojoalg / sequencer
  Sequencer: Deep LSTM for Image Classification
  ☆143Updated 3 years ago
• Chenglin-Yang / LVT
  Lite Vision Transformer (CVPR 2022)
  ☆145Updated 2 years ago
• google-research / nested-transformer
  Nested Hierarchical Transformer https://arxiv.org/pdf/2105.12723.pdf
  ☆198Updated last year
• kuixu / Linear-Multihead-Attention
  Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)
  ☆75Updated 5 years ago
• shikishima-TasakiLab / Involution-PyTorch
  Unofficial PyTorch reimplemention of the paper "Involution: Inverting the Inherence of Convolution for Visual Recognition" [CVPR 2021].
  ☆21Updated 4 years ago
• ggjy / Hire-Wave-MLP.pytorch
  Implementation of Hire-MLP: Vision MLP via Hierarchical Rearrangement and An Image Patch is a Wave: Phase-Aware Vision MLP.
  ☆37Updated 2 years ago
• cmsflash / efficient-attention
  An implementation of the efficient attention module.
  ☆321Updated 4 years ago
• yun-liu / HAT-Net
  Vision Transformers with Hierarchical Attention
  ☆102Updated 3 weeks ago
• danczs / Visformer
  ☆135Updated 2 years ago
• slwang9353 / MobileFormer
  MobileFormer in torch
  ☆66Updated 4 years ago
• Qualcomm-AI-research / FFNet
  ☆66Updated last year
• ShoufaChen / CycleMLP
  [ICLR'22 Oral] Implementation of "CycleMLP: A MLP-like Architecture for Dense Prediction"
  ☆290Updated 3 years ago
• ma-xu / SPANet
  Codes of "SPANet: Spatial Pyramid Attention Network for Enhanced Image Recognition"
  ☆26Updated 5 years ago
• VinAIResearch / MagNet
  Progressive Semantic Segmentation (CVPR-2021)
  ☆121Updated 10 months ago
• VITA-Group / SLaK
  [ICLR 2023] "More ConvNets in the 2020s: Scaling up Kernels Beyond 51x51 using Sparsity"; [ICML 2023] "Are Large Kernels Better Teachers…
  ☆279Updated 2 years ago
• lehduong / torch-warmup-lr
  Warmup learning rate wrapper for Pytorch Scheduler
  ☆41Updated 5 years ago
• ACheun9 / Pytorch-implementation-of-Mobile-Former
  Simple implementation of Mobile-Former on Pytorch
  ☆108Updated 4 years ago
• lucidrains / halonet-pytorch
  Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones
  ☆200Updated 4 years ago
• wofmanaf / ResT
  This is an official implementation for "ResT: An Efficient Transformer for Visual Recognition".
  ☆288Updated 3 years ago
• lucidrains / res-mlp-pytorch
  Implementation of ResMLP, an all MLP solution to image classification, in Pytorch
  ☆200Updated 2 years ago