hunto / LightViT
Official implementation for paper "LightViT: Towards Light-Weight Convolution-Free Vision Transformers"
☆137Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for LightViT
- CVPR 2022 "Online Convolutional Re-parameterization"☆169Updated 2 years ago
- ☆149Updated last year
- [ICLR'22] This is an official implementation for "AS-MLP: An Axial Shifted MLP Architecture for Vision".☆124Updated 2 years ago
- ☆121Updated last year
- Lite Vision Transformer (CVPR 2022)☆134Updated 2 years ago
- The official implementation of ELSA: Enhanced Local Self-Attention for Vision Transformer☆115Updated last year
- MobileFormer in torch☆66Updated 3 years ago
- (AAAI 2023 Oral) Pytorch implementation of "CF-ViT: A General Coarse-to-Fine Method for Vision Transformer"☆101Updated last year
- Official code for paper "On the Connection between Local Attention and Dynamic Depth-wise Convolution" ICLR 2022 Spotlight☆183Updated 2 years ago
- Code and models for mobile-former☆119Updated 2 years ago
- Official Code of Paper "Reversible Column Networks" "RevColv2"☆250Updated last year
- ☆210Updated 2 years ago
- Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.☆81Updated 8 months ago
- RepGhost: A Hardware-Efficient Ghost Module via Re-parameterization☆170Updated last year
- Masked Generative Distillation (ECCV 2022)☆214Updated 2 years ago
- This is an official implementation for "Scale-Aware Modulation Meet Transformer".☆193Updated last year
- Official MegEngine implementation of RepLKNet☆268Updated 2 years ago
- This is code of paper "ScalableViT: Rethinking the Context-oriented Generalization of Vision Transformer"☆26Updated last year
- (CVPR2023/TPAMI2024) Integrally Pre-Trained Transformer Pyramid Networks -- A Hierarchical Vision Transformer for Masked Image Modeling☆175Updated 3 months ago
- [ICLR 2024 poster] Efficient Modulation for Vision Networks☆48Updated 4 months ago
- PyTorch code and checkpoints release for VanillaKD: https://arxiv.org/abs/2305.15781☆71Updated last year
- MSG-Transformer: Exchanging Local Spatial Information by Manipulating Messenger Tokens (CVPR 2022)☆81Updated 2 years ago
- PyTorch code and checkpoints release for OFA-KD: https://arxiv.org/abs/2310.19444☆97Updated 7 months ago
- ☆191Updated 3 years ago
- [ECCV 2022] EdgeViT: Competing Light-weight CNNs on Mobile Devices with Vision Transformers☆100Updated last year
- CrossKD: Cross-Head Knowledge Distillation for Dense Object Detection☆143Updated last year
- Official code for our ECCV'22 paper "A Fast Knowledge Distillation Framework for Visual Recognition"☆181Updated 6 months ago
- [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "Fast Vision Transformers with HiLo Attention"☆254Updated last year
- [CVPR 2023] Official implementation of the paper "Lite DETR : An Interleaved Multi-Scale Encoder for Efficient DETR"☆185Updated last year
- ☆82Updated last year