Alternatives and similar repositories for Linear-Attention-Mechanism:

Users that are interested in Linear-Attention-Mechanism are comparing it to the libraries listed below

• svip-lab / AS-MLP
  [ICLR'22] This is an official implementation for "AS-MLP: An Axial Shifted MLP Architecture for Vision".
  ☆126Updated 2 years ago
• yan-hao-tian / VW
  iclr2024 poster Varying Window Attention
  ☆119Updated 3 months ago
• Meituan-AutoML / CPVT
  ☆191Updated last year
• jiaozizhao / LiftPool
  ☆20Updated 3 years ago
• wilile26811249 / CMT_CNN-meet-Vision-Transformer
  A PyTorch implementation of CMT based on paper CMT: Convolutional Neural Networks Meet Vision Transformers.
  ☆68Updated last year
• rishikksh20 / CeiT-pytorch
  Implementation of Convolutional enhanced image Transformer
  ☆102Updated 3 years ago
• frank-xwang / TBC-TiedBlockConvolution
  [AAAI 2021] Pytorch implementation for "Tied Block Convolution: Leaner and Better CNNs with Shared Thinner Filters."
  ☆35Updated 3 years ago
• Chenglin-Yang / LVT
  Lite Vision Transformer (CVPR 2022)
  ☆137Updated 2 years ago
• houqb / VisionPermutator
  MLP-Like Vision Permutator for Visual Recognition (PyTorch)
  ☆191Updated 2 years ago
• zh460045050 / SNL_ICCV2021
  Official implementation of the paper ``Unifying Nonlocal Blocks for Neural Networks'' (ICCV'21)
  ☆96Updated 2 years ago
• alexandrosstergiou / adaPool
  [T-IP 2023] Code for exponential adaptive pooling for PyTorch
  ☆81Updated last year
• ShoufaChen / CycleMLP
  [ICLR'22 Oral] Implementation of "CycleMLP: A MLP-like Architecture for Dense Prediction"
  ☆282Updated 2 years ago
• ofsoundof / LocalViT
  ☆119Updated 2 years ago
• liuruiyang98 / Jittor-MLP
  Unofficial Implementation of MLP-Mixer, gMLP, resMLP, Vision Permutator, S2MLP, S2MLPv2, RaftMLP, HireMLP, ConvMLP, AS-MLP, SparseMLP, Co…
  ☆168Updated 2 years ago
• ma-xu / FCViT
  A Close Look at Spatial Modeling: From Attention to Convolution
  ☆91Updated 2 years ago
• LayneH / GreenMIM
  [NeurIPS2022] Official implementation of the paper 'Green Hierarchical Vision Transformer for Masked Image Modeling'.
  ☆173Updated 2 years ago
• ggjy / Hire-Wave-MLP.pytorch
  Implementation of Hire-MLP: Vision MLP via Hierarchical Rearrangement and An Image Patch is a Wave: Phase-Aware Vision MLP.
  ☆34Updated 2 years ago
• Atten4Vis / DemystifyLocalViT
  Official code for paper "On the Connection between Local Attention and Dynamic Depth-wise Convolution" ICLR 2022 Spotlight
  ☆184Updated 2 years ago
• wofmanaf / ResT
  This is an official implementation for "ResT: An Efficient Transformer for Visual Recognition".
  ☆282Updated 2 years ago
• danczs / Visformer
  ☆132Updated last year
• yun-liu / HAT-Net
  Vision Transformers with Hierarchical Attention
  ☆99Updated 4 months ago
• linhezheng19 / CAT
  Official implement of "CAT: Cross Attention in Vision Transformer".
  ☆154Updated 2 years ago
• microsoft / SPACH
  ☆197Updated 6 months ago
• okojoalg / sequencer
  Sequencer: Deep LSTM for Image Classification
  ☆140Updated 2 years ago
• zhoudaquan / Refiner_ViT
  ☆108Updated 3 years ago
• yan-hao-tian / ConTNet
  This repo contains the code of "ConTNet: Why not use convolution and transformer at the same time?"
  ☆96Updated 3 years ago
• ucasligang / SimViT
  [ICME 2022] code for the paper, SimVit: Exploring a simple vision transformer with sliding windows.
  ☆67Updated 2 years ago
• lucidrains / global-self-attention-network
  A Pytorch implementation of Global Self-Attention Network, a fully-attention backbone for vision tasks
  ☆93Updated 4 years ago
• WangFeng18 / Swin-Transformer
  Implementation of Swin Transformer with Pytorch
  ☆110Updated 3 years ago
• mulinmeng / Shuffle-Transformer
  ☆98Updated 2 years ago