Official implementation for paper "LightViT: Towards Light-Weight Convolution-Free Vision Transformers"
☆143Jul 26, 2022Updated 3 years ago
Alternatives and similar repositories for LightViT
Users that are interested in LightViT are comparing it to the libraries listed below
Sorting:
- Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.☆87Mar 20, 2024Updated last year
- Lite Vision Transformer (CVPR 2022)☆144Oct 21, 2022Updated 3 years ago
- [ECCV 2022] Source code of "EdgeFormer: Improving Light-weight ConvNets by Learning from Vision Transformers"☆357Dec 14, 2022Updated 3 years ago
- This is an official implementation for "ResT: An Efficient Transformer for Visual Recognition".☆292Sep 28, 2022Updated 3 years ago
- Official code for our ECCV'22 paper "A Fast Knowledge Distillation Framework for Visual Recognition"☆190Apr 29, 2024Updated last year
- iFormer: Inception Transformer☆248Jan 14, 2023Updated 3 years ago
- ☆76Sep 30, 2022Updated 3 years ago
- Directed masked autoencoders☆14Feb 20, 2026Updated last week
- [ICLR'22] This is an official implementation for "AS-MLP: An Axial Shifted MLP Architecture for Vision".☆127Oct 15, 2022Updated 3 years ago
- [ECCV 2022] EdgeViT: Competing Light-weight CNNs on Mobile Devices with Vision Transformers☆115Mar 14, 2023Updated 2 years ago
- Pytorch implementation of Mix-Shifting-MLP (MS-MLP)☆16Feb 16, 2022Updated 4 years ago
- Pytorch implementation of our paper accepted by ECCV2022 -- Knowledge Condensation Distillation https://arxiv.org/abs/2207.05409☆30Dec 21, 2022Updated 3 years ago
- Official implementation for paper "DyRep: Bootstrapping Training with Dynamic Re-parameterization", CVPR 2022☆43Jun 13, 2022Updated 3 years ago
- [CADL'22, ECCVW] Official repository of paper titled "EdgeNeXt: Efficiently Amalgamated CNN-Transformer Architecture for Mobile Vision Ap…☆411Jul 25, 2023Updated 2 years ago
- Official code for paper "On the Connection between Local Attention and Dynamic Depth-wise Convolution" ICLR 2022 Spotlight☆185Nov 17, 2022Updated 3 years ago
- [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "Fast Vision Transformers with HiLo Attention"☆297Nov 17, 2023Updated 2 years ago
- [ICCV 2023] Official PyTorch implementation of "Rethinking Mobile Block for Efficient Attention-based Models"☆254Oct 24, 2023Updated 2 years ago
- Scaling Up Your Kernels to 31x31: Revisiting Large Kernel Design in CNNs (CVPR 2022)☆940Apr 24, 2024Updated last year
- [Preprint] ConvMLP: Hierarchical Convolutional MLPs for Vision, 2021☆167Oct 11, 2022Updated 3 years ago
- ☆214Dec 17, 2021Updated 4 years ago
- CVNets: A library for training computer vision networks☆1,967Oct 30, 2023Updated 2 years ago
- Official implementation for paper "Relational Surrogate Loss Learning", ICLR 2022☆37Nov 25, 2022Updated 3 years ago
- Official Pytorch implementations for "SegNeXt: Rethinking Convolutional Attention Design for Semantic Segmentation" (NeurIPS 2022)☆869Nov 22, 2022Updated 3 years ago
- EfficientFormerV2 [ICCV 2023] & EfficientFormer [NeurIPs 2022]☆1,109Aug 13, 2023Updated 2 years ago
- This is a collection of our NAS and Vision Transformer work.☆1,823Jul 25, 2024Updated last year
- ConvMAE: Masked Convolution Meets Masked Autoencoders☆524Mar 14, 2023Updated 2 years ago
- Official implementation for "SimA: Simple Softmax-free Attention for Vision Transformers"☆46Apr 18, 2024Updated last year
- Lightweight and Progressively-Scalable Networks for Semantic Segmentation☆52Jul 28, 2022Updated 3 years ago
- A Close Look at Spatial Modeling: From Attention to Convolution☆92Dec 27, 2022Updated 3 years ago
- PyTorch reimplementation of the paper "MaxViT: Multi-Axis Vision Transformer" [ECCV 2022].☆164Jul 12, 2023Updated 2 years ago
- PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)☆1,367Jun 1, 2024Updated last year
- Masked Generative Distillation (ECCV 2022)☆240Nov 9, 2022Updated 3 years ago
- This is an official implementation for "Contextual Transformer Networks for Visual Recognition".☆538Aug 8, 2021Updated 4 years ago
- [NeurIPS2022] Official implementation of the paper 'Green Hierarchical Vision Transformer for Masked Image Modeling'.☆177Jan 16, 2023Updated 3 years ago
- [IEEE TPAMI'23] Pyramid Pooling Transformer for Scene Understanding☆220Jun 16, 2025Updated 8 months ago
- Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022☆155Dec 28, 2022Updated 3 years ago
- [ICLR 2023] "More ConvNets in the 2020s: Scaling up Kernels Beyond 51x51 using Sparsity"; [ICML 2023] "Are Large Kernels Better Teachers…☆284Jul 5, 2023Updated 2 years ago
- CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped, CVPR 2022☆589Nov 1, 2023Updated 2 years ago
- Official PyTorch implementation of the paper: "Solving ImageNet: a Unified Scheme for Training any Backbone to Top Results" (2022)☆193Jan 11, 2023Updated 3 years ago