hunto / LightViT
Official implementation for paper "LightViT: Towards Light-Weight Convolution-Free Vision Transformers"
☆139Updated 2 years ago
Alternatives and similar repositories for LightViT:
Users that are interested in LightViT are comparing it to the libraries listed below
- ☆170Updated 2 months ago
- ☆126Updated 2 years ago
- Code and models for mobile-former☆122Updated 2 years ago
- CVPR 2022 "Online Convolutional Re-parameterization"☆174Updated 2 years ago
- Lite Vision Transformer (CVPR 2022)☆138Updated 2 years ago
- The official implementation of ELSA: Enhanced Local Self-Attention for Vision Transformer☆116Updated last year
- [ICCV2023] This is an official implementation for "Scale-Aware Modulation Meet Transformer".☆199Updated last year
- [ICLR'22] This is an official implementation for "AS-MLP: An Axial Shifted MLP Architecture for Vision".☆126Updated 2 years ago
- Masked Generative Distillation (ECCV 2022)☆217Updated 2 years ago
- RepGhost: A Hardware-Efficient Ghost Module via Re-parameterization☆175Updated last year
- ☆214Updated 3 years ago
- (AAAI 2023 Oral) Pytorch implementation of "CF-ViT: A General Coarse-to-Fine Method for Vision Transformer"☆103Updated last year
- Official code for paper "On the Connection between Local Attention and Dynamic Depth-wise Convolution" ICLR 2022 Spotlight☆184Updated 2 years ago
- Official MegEngine implementation of RepLKNet☆275Updated 2 years ago
- [ECCV 2022] Source code of "EdgeFormer: Improving Light-weight ConvNets by Learning from Vision Transformers"☆351Updated 2 years ago
- MSG-Transformer: Exchanging Local Spatial Information by Manipulating Messenger Tokens (CVPR 2022)☆82Updated 2 years ago
- MobileFormer in torch☆66Updated 3 years ago
- Official Code of Paper "Reversible Column Networks" "RevColv2"☆259Updated last year
- A Close Look at Spatial Modeling: From Attention to Convolution☆91Updated 2 years ago
- This is code of paper "ScalableViT: Rethinking the Context-oriented Generalization of Vision Transformer"☆26Updated last year
- ☆193Updated 3 years ago
- [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "Fast Vision Transformers with HiLo Attention"☆268Updated last year
- ☆77Updated 2 years ago
- ☆75Updated 2 years ago
- CMT: Convolutional Neural Networks Meet Vision Transformers☆119Updated 3 years ago
- Official implementation of paper "Masked Distillation with Receptive Tokens", ICLR 2023.☆68Updated last year
- [TPAMI22] Pyramid Pooling Transformer for Scene Understanding☆208Updated last year
- ☆81Updated 3 years ago
- ☆62Updated 2 years ago
- [AAAI 2022] This is the official PyTorch implementation of "Less is More: Pay Less Attention in Vision Transformers"☆94Updated 2 years ago