VITA-Group / SLaK
[ICLR 2023] "More ConvNets in the 2020s: Scaling up Kernels Beyond 51x51 using Sparsity"; [ICML 2023] "Are Large Kernels Better Teachers than Transformers for ConvNets?"
☆263Updated last year
Related projects: ⓘ
- Official MegEngine implementation of RepLKNet☆269Updated 2 years ago
- Official Code of Paper "Reversible Column Networks" "RevColv2"☆246Updated last year
- [ICCV 2023] You Only Look at One Partial Sequence☆335Updated 10 months ago
- Official PyTorch implementation of Fully Attentional Networks☆464Updated last year
- InceptionNeXt: When Inception Meets ConvNeXt (CVPR 2024)☆225Updated 10 months ago
- [ECCV 2022]Code for paper "DaViT: Dual Attention Vision Transformer"☆321Updated 7 months ago
- MetaFormer Baselines for Vision (TPAMI 2024)☆400Updated 3 months ago
- [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "Fast Vision Transformers with HiLo Attention"☆239Updated 10 months ago
- ☆209Updated 2 years ago
- PyTorch reimplementation of the paper "MaxViT: Multi-Axis Vision Transformer" [ECCV 2022].☆157Updated last year
- LeViT a Vision Transformer in ConvNet's Clothing for Faster Inference☆596Updated 2 years ago
- [CVPR 2022 Oral] Crafting Better Contrastive Views for Siamese Representation Learning☆284Updated 2 years ago
- [NeurIPS2022] Official implementation of the paper 'Green Hierarchical Vision Transformer for Masked Image Modeling'.☆169Updated last year
- [NeurIPS 2021] [T-PAMI] DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsification☆556Updated last year
- Official Codes for "Uniform Masking: Enabling MAE Pre-training for Pyramid-based Vision Transformers with Locality"☆238Updated last year
- 1.5−3.0× lossless training or pre-training speedup. An off-the-shelf, easy-to-implement algorithm for the efficient training of foundatio…☆196Updated 3 weeks ago
- Lite Vision Transformer (CVPR 2022)☆134Updated last year
- ☆194Updated last month
- [NeurIPS 2022] HorNet: Efficient High-Order Spatial Interactions with Recursive Gated Convolutions☆316Updated 8 months ago
- Code and models for mobile-former☆116Updated 2 years ago
- [CADL'22, ECCVW] Official repository of paper titled "EdgeNeXt: Efficiently Amalgamated CNN-Transformer Architecture for Mobile Vision Ap…☆342Updated last year
- ☆235Updated last year
- [ICLR'22 Oral] Implementation of "CycleMLP: A MLP-like Architecture for Dense Prediction"☆280Updated 2 years ago
- Official code for paper "On the Connection between Local Attention and Dynamic Depth-wise Convolution" ICLR 2022 Spotlight☆182Updated last year
- [ICML 2023] Official PyTorch implementation of Global Context Vision Transformers☆421Updated 8 months ago
- Pytorch implementation of "All Tokens Matter: Token Labeling for Training Better Vision Transformers"☆425Updated last year
- ☆188Updated last year
- MLP-Like Vision Permutator for Visual Recognition (PyTorch)☆189Updated 2 years ago
- ConvMAE: Masked Convolution Meets Masked Autoencoders☆476Updated last year
- Official implement for ICML2023 paper: "A Closer Look at Self-Supervised Lightweight Vision Transformers"☆109Updated last year