Alternatives and similar repositories for skip-attention

Users that are interested in skip-attention are comparing it to the libraries listed below

• ruitian12 / resformer
  Official PyTorch implementation of ResFormer: Scaling ViTs with Multi-Resolution Training, CVPR2023
  ☆29Updated 2 years ago
• DoctorKey / Practise
  [CVPR2023] Practical Network Acceleration with Tiny Sets
  ☆14Updated last year
• xuchenhao001 / HSViT
  HSViT: Horizontally Scalable Vision Transformer
  ☆13Updated 8 months ago
• pzhren / DW-ViT
  ☆33Updated 3 years ago
• mahaoyuHKU / pytorch-boat
  This is an unofficial implementation of BOAT: Bilateral Local Attention Vision Transformer
  ☆55Updated 3 years ago
• roymiles / VkD
  [CVPR 2024] VkD : Improving Knowledge Distillation using Orthogonal Projections
  ☆54Updated 8 months ago
• lingeringlight / ALOFT
  The official implementation for ALOFT (CVPR 2023).
  ☆55Updated last year
• JegZheng / MS-MLP
  Pytorch implementation of Mix-Shifting-MLP (MS-MLP)
  ☆16Updated 3 years ago
• BGU-CS-VIL / DiTAC
  Trainable Highly-expressive Activation Functions. ECCV 2024
  ☆37Updated 4 months ago
• jianlong-yuan / UniNeXt
  ☆44Updated 2 years ago
• zhangzjn / EATFormer
  EATFormer: Improving Vision Transformer Inspired by Evolutionary Algorithm
  ☆34Updated 2 years ago
• shwangtangjun / Diff-ResNet
  PyTorch code for Diffusion Mechanism in Neural Network: Theory and Applications
  ☆39Updated last year
• xdeng7 / NightLab
  ☆29Updated 3 years ago
• luckybird1994 / SAMCOD
  ☆36Updated 2 years ago
• hfutqian / SwitOKD
  Switchable Online Knowledge Distillation
  ☆18Updated 8 months ago
• Yangr116 / ScalableViT
  This is code of paper "ScalableViT: Rethinking the Context-oriented Generalization of Vision Transformer"
  ☆26Updated last year
• sunshangquan / TransMamba
  ☆50Updated 10 months ago
• IBM / RegionViT
  open source the research work for published on arxiv. https://arxiv.org/abs/2106.02689
  ☆52Updated 3 years ago
• wangck20 / GlobalMamba
  ☆25Updated 8 months ago
• Natlem / M-HTCN
  ☆12Updated 7 months ago
• SenJia / Position-Information
  How Much Position Information Do Convolutional Neural Networks Encode?
  ☆11Updated 3 years ago
• fanyang587 / UGTR
  ☆35Updated 2 years ago
• Ackesnal / GTP-ViT
  This is the official code for paper: Token Summarisation for Efficient Vision Transformers via Graph-based Token Propagation
  ☆29Updated last year
• UCDvision / sima
  Official implementation for "SimA: Simple Softmax-free Attention for Vision Transformers"
  ☆43Updated last year
• wzpscott / SegDistill
  Knowledge Distillation Toolbox for Semantic Segmentation
  ☆17Updated 2 years ago
• JiamingLv / WKD
  The offical implementation of [NeurIPS2024] Wasserstein Distance Rivals Kullback-Leibler Divergence for Knowledge Distillation https://ar…
  ☆42Updated 6 months ago
• Gumpest / AvatarKD
  [ACM MM'23] Official implementation of paper "Avatar Knowledge Distillation: Self-ensemble Teacher Paradigm with Uncertainty".
  ☆13Updated last year
• marsggbo / EAGAN
  (ECCV2022) EAGAN: EAGAN: Efficient Two-stage Evolutionary Architecture Search for GANs
  ☆12Updated 2 years ago
• drlxj / CamDiff
  ☆31Updated last year
• lmbxmu / DCFF
  Pytorch implementation (TPAMI 2023) - Training Compact CNNs for Image Classification using Dynamic-coded Filter Fusion
  ☆19Updated 2 years ago