Alternatives and similar repositories for LightViT:

Users that are interested in LightViT are comparing it to the libraries listed below

• Chenglin-Yang / LVT
  Lite Vision Transformer (CVPR 2022)
  ☆142Updated 2 years ago
• HVision-NKU / Conv2Former
  ☆176Updated 4 months ago
• AAboys / MobileFormer
  Code and models for mobile-former
  ☆123Updated 2 years ago
• svip-lab / AS-MLP
  [ICLR'22] This is an official implementation for "AS-MLP: An Axial Shifted MLP Architecture for Vision".
  ☆126Updated 2 years ago
• OliverRensu / Shunted-Transformer
  ☆215Updated 3 years ago
• JUGGHM / OREPA_CVPR2022
  CVPR 2022 "Online Convolutional Re-parameterization"
  ☆176Updated 3 years ago
• Atten4Vis / DemystifyLocalViT
  Official code for paper "On the Connection between Local Attention and Dynamic Depth-wise Convolution" ICLR 2022 Spotlight
  ☆184Updated 2 years ago
• yzd-v / MGD
  Masked Generative Distillation (ECCV 2022)
  ☆221Updated 2 years ago
• ChenMnZ / CF-ViT
  (AAAI 2023 Oral) Pytorch implementation of "CF-ViT: A General Coarse-to-Fine Method for Vision Transformer"
  ☆103Updated last year
• AFeng-x / SMT
  [ICCV2023] This is an official implementation for "Scale-Aware Modulation Meet Transformer".
  ☆200Updated last year
• hunto / image_classification_sota
  Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.
  ☆82Updated last year
• dongbo811 / AFFormer
  ☆131Updated 2 years ago
• damo-cv / ELSA
  The official implementation of ELSA: Enhanced Local Self-Attention for Vision Transformer
  ☆116Updated last year
• saic-fi / edgevit
  [ECCV 2022] EdgeViT: Competing Light-weight CNNs on Mobile Devices with Vision Transformers
  ☆107Updated 2 years ago
• hkzhang-git / ParC-Net
  [ECCV 2022] Source code of "EdgeFormer: Improving Light-weight ConvNets by Learning from Vision Transformers"
  ☆351Updated 2 years ago
• megvii-research / RevCol
  Official Code of Paper "Reversible Column Networks" "RevColv2"
  ☆260Updated last year
• MegEngine / RepLKNet
  Official MegEngine implementation of RepLKNet
  ☆275Updated 3 years ago
• ma-xu / FCViT
  A Close Look at Spatial Modeling: From Attention to Convolution
  ☆91Updated 2 years ago
• hunto / MasKD
  Official implementation of paper "Masked Distillation with Receptive Tokens", ICLR 2023.
  ☆68Updated 2 years ago
• Yangr116 / ScalableViT
  This is code of paper "ScalableViT: Rethinking the Context-oriented Generalization of Vision Transformer"
  ☆26Updated last year
• ziplab / LITv2
  [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "Fast Vision Transformers with HiLo Attention"
  ☆274Updated last year
• yuhuan-wu / P2T
  [TPAMI22] Pyramid Pooling Transformer for Scene Understanding
  ☆209Updated last year
• ChristophReich1996 / MaxViT
  PyTorch reimplementation of the paper "MaxViT: Multi-Axis Vision Transformer" [ECCV 2022].
  ☆162Updated last year
• FlyEgle / CMT-pytorch
  CMT: Convolutional Neural Networks Meet Vision Transformers
  ☆119Updated 3 years ago
• CASIA-IVA-Lab / DPT
  DPT: Deformable Patch-based Transformer for Visual Recognition (ACM MM2021)
  ☆155Updated 3 years ago
• ChengpengChen / RepGhost
  RepGhost: A Hardware-Efficient Ghost Module via Re-parameterization
  ☆176Updated last year
• LayneH / GreenMIM
  [NeurIPS2022] Official implementation of the paper 'Green Hierarchical Vision Transformer for Masked Image Modeling'.
  ☆173Updated 2 years ago
• slwang9353 / MobileFormer
  MobileFormer in torch
  ☆66Updated 3 years ago
• linhezheng19 / CAT
  Official implement of "CAT: Cross Attention in Vision Transformer".
  ☆159Updated 2 years ago
• hustvl / MSG-Transformer
  MSG-Transformer: Exchanging Local Spatial Information by Manipulating Messenger Tokens (CVPR 2022)
  ☆81Updated 2 years ago