Alternatives and similar repositories for skip-attention

Users that are interested in skip-attention are comparing it to the libraries listed below

• mahaoyuHKU / pytorch-boat
  This is an unofficial implementation of BOAT: Bilateral Local Attention Vision Transformer
  ☆55Updated 3 years ago
• ruitian12 / resformer
  Official PyTorch implementation of ResFormer: Scaling ViTs with Multi-Resolution Training, CVPR2023
  ☆29Updated 2 years ago
• BGU-CS-VIL / DiTAC
  Trainable Highly-expressive Activation Functions. ECCV 2024
  ☆37Updated 6 months ago
• roymiles / VkD
  [CVPR 2024] VkD : Improving Knowledge Distillation using Orthogonal Projections
  ☆55Updated 11 months ago
• sunshangquan / TransMamba
  ☆57Updated last year
• pzhren / DW-ViT
  ☆32Updated 3 years ago
• lingeringlight / ALOFT
  The official implementation for ALOFT (CVPR 2023).
  ☆56Updated 2 years ago
• shwangtangjun / Diff-ResNet
  PyTorch code for Diffusion Mechanism in Neural Network: Theory and Applications
  ☆40Updated last year
• iVMCL / PaCaViT
  PyTorch implementation of PaCa-ViT (CVPR'23)
  ☆33Updated 2 years ago
• badripatro / svt
  Scattering Vision Transformer
  ☆53Updated last year
• ChenhongyiYang / PlainMamba
  [BMVC 2024] PlainMamba: Improving Non-hierarchical Mamba in Visual Recognition
  ☆80Updated 5 months ago
• nkusyl / FViT
  Official code release of our paper "FViT: A Focal Vision Transformer with Gabor Filter"
  ☆18Updated last month
• microsoft / TokenMixers
  ☆151Updated last year
• cp3wan / DFormer
  ☆60Updated 2 years ago
• ziplab / LIT
  [AAAI 2022] This is the official PyTorch implementation of "Less is More: Pay Less Attention in Vision Transformers"
  ☆97Updated 3 years ago
• hunto / image_classification_sota
  Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.
  ☆84Updated last year
• zhangzjn / EATFormer
  EATFormer: Improving Vision Transformer Inspired by Evolutionary Algorithm
  ☆34Updated 3 years ago
• xdeng7 / NightLab
  ☆30Updated 3 years ago
• nkusyl / EViT
  Official code release of our paper "EViT: An Eagle Vision Transformer with Bi-Fovea Self-Attention"
  ☆21Updated last month
• ChenMnZ / CF-ViT
  (AAAI 2023 Oral) Pytorch implementation of "CF-ViT: A General Coarse-to-Fine Method for Vision Transformer"
  ☆105Updated 2 years ago
• XudongLinthu / context-gated-convolution
  Implementation for Context-Gated Convolution
  ☆60Updated 3 years ago
• ofsoundof / LocalViT
  ☆117Updated 3 years ago
• altair199797 / LowFormer
  ☆33Updated 6 months ago
• li-jl16 / LORS
  CVPR2024 highlight.
  ☆13Updated 11 months ago
• fanyang587 / UGTR
  ☆36Updated 2 years ago
• Haoqing-Wang / LocalMIM
  [CVPR 2023 Highlight] Masked Image Modeling with Local Multi-Scale Reconstruction
  ☆52Updated 2 years ago
• yun-liu / HAT-Net
  Vision Transformers with Hierarchical Attention
  ☆102Updated last week
• zmhhmz / GPCIS_CVPR2023
  ☆42Updated 2 years ago
• drlxj / CamDiff
  ☆31Updated last year
• jiawangbai / HAT
  Implementation of HAT https://arxiv.org/pdf/2204.00993
  ☆51Updated last year