hunto / LightViT
Official implementation for paper "LightViT: Towards Light-Weight Convolution-Free Vision Transformers"
☆139Updated 2 years ago
Alternatives and similar repositories for LightViT:
Users that are interested in LightViT are comparing it to the libraries listed below
- ☆170Updated 2 months ago
- ☆128Updated 2 years ago
- Lite Vision Transformer (CVPR 2022)☆139Updated 2 years ago
- Code and models for mobile-former☆123Updated 2 years ago
- [ICLR'22] This is an official implementation for "AS-MLP: An Axial Shifted MLP Architecture for Vision".☆126Updated 2 years ago
- CVPR 2022 "Online Convolutional Re-parameterization"☆174Updated 2 years ago
- The official implementation of ELSA: Enhanced Local Self-Attention for Vision Transformer☆116Updated last year
- ☆214Updated 3 years ago
- [ICCV2023] This is an official implementation for "Scale-Aware Modulation Meet Transformer".☆199Updated last year
- Official MegEngine implementation of RepLKNet☆275Updated 2 years ago
- This is code of paper "ScalableViT: Rethinking the Context-oriented Generalization of Vision Transformer"☆26Updated last year
- RepGhost: A Hardware-Efficient Ghost Module via Re-parameterization☆175Updated last year
- A Close Look at Spatial Modeling: From Attention to Convolution☆91Updated 2 years ago
- [ECCV 2022] EdgeViT: Competing Light-weight CNNs on Mobile Devices with Vision Transformers☆106Updated 2 years ago
- Masked Generative Distillation (ECCV 2022)☆217Updated 2 years ago
- (AAAI 2023 Oral) Pytorch implementation of "CF-ViT: A General Coarse-to-Fine Method for Vision Transformer"☆103Updated last year
- Official code for paper "On the Connection between Local Attention and Dynamic Depth-wise Convolution" ICLR 2022 Spotlight☆184Updated 2 years ago
- [NeurIPS2022] Official implementation of the paper 'Green Hierarchical Vision Transformer for Masked Image Modeling'.☆174Updated 2 years ago
- Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.☆82Updated last year
- MSG-Transformer: Exchanging Local Spatial Information by Manipulating Messenger Tokens (CVPR 2022)☆82Updated 2 years ago
- Official implementation of paper "Masked Distillation with Receptive Tokens", ICLR 2023.☆68Updated last year
- Official Code of Paper "Reversible Column Networks" "RevColv2"☆260Updated last year
- [CVPR 2022] TVConv: Efficient Translation Variant Convolution for Layout-aware Visual Processing☆46Updated 2 years ago
- [ICLR 2024 poster] Efficient Modulation for Vision Networks☆52Updated 8 months ago
- ☆63Updated 2 years ago
- MobileFormer in torch☆66Updated 3 years ago
- Official implementation of the paper ``Unifying Nonlocal Blocks for Neural Networks'' (ICCV'21)☆98Updated 3 years ago
- ☆78Updated 2 years ago
- DPT: Deformable Patch-based Transformer for Visual Recognition (ACM MM2021)☆153Updated 3 years ago
- ☆136Updated 8 months ago