VITA-Group / SLaK
[ICLR 2023] "More ConvNets in the 2020s: Scaling up Kernels Beyond 51x51 using Sparsity"; [ICML 2023] "Are Large Kernels Better Teachers than Transformers for ConvNets?"
☆264Updated last year
Alternatives and similar repositories for SLaK:
Users that are interested in SLaK are comparing it to the libraries listed below
- Official MegEngine implementation of RepLKNet☆273Updated 2 years ago
- Official Code of Paper "Reversible Column Networks" "RevColv2"☆258Updated last year
- PyTorch reimplementation of the paper "MaxViT: Multi-Axis Vision Transformer" [ECCV 2022].☆161Updated last year
- ☆213Updated 3 years ago
- [ECCV 2022]Code for paper "DaViT: Dual Attention Vision Transformer"☆345Updated last year
- [NeurIPS 2022] HorNet: Efficient High-Order Spatial Interactions with Recursive Gated Convolutions☆327Updated last year
- Code and models for mobile-former☆121Updated 2 years ago
- ☆249Updated 2 years ago
- MLP-Like Vision Permutator for Visual Recognition (PyTorch)☆191Updated 2 years ago
- ☆197Updated 6 months ago
- MetaFormer Baselines for Vision (TPAMI 2024)☆443Updated 8 months ago
- Lite Vision Transformer (CVPR 2022)☆137Updated 2 years ago
- [NeurIPS2022] Official implementation of the paper 'Green Hierarchical Vision Transformer for Masked Image Modeling'.☆173Updated 2 years ago
- Official code for paper "On the Connection between Local Attention and Dynamic Depth-wise Convolution" ICLR 2022 Spotlight☆184Updated 2 years ago
- [ICCV 2023] You Only Look at One Partial Sequence☆340Updated last year
- Scaling Up Your Kernels to 31x31: Revisiting Large Kernel Design in CNNs (CVPR 2022)☆891Updated 9 months ago
- Python code for ICLR 2022 spotlight paper EViT: Expediting Vision Transformers via Token Reorganizations☆176Updated last year
- [ECCV 2022] EdgeViT: Competing Light-weight CNNs on Mobile Devices with Vision Transformers☆105Updated last year
- InceptionNeXt: When Inception Meets ConvNeXt (CVPR 2024)☆276Updated 2 months ago
- [CADL'22, ECCVW] Official repository of paper titled "EdgeNeXt: Efficiently Amalgamated CNN-Transformer Architecture for Mobile Vision Ap…☆359Updated last year
- [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "Fast Vision Transformers with HiLo Attention"☆267Updated last year
- [ECCV 2022] Official repository for "MaxViT: Multi-Axis Vision Transformer". SOTA foundation models for classification, detection, segmen…☆457Updated last year
- [ICML 2023] Official PyTorch implementation of Global Context Vision Transformers☆429Updated last year
- Official implementation for paper "LightViT: Towards Light-Weight Convolution-Free Vision Transformers"☆137Updated 2 years ago
- [NeurIPS 2021] [T-PAMI] DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsification☆593Updated last year
- Official Codes for "Uniform Masking: Enabling MAE Pre-training for Pyramid-based Vision Transformers with Locality"☆243Updated 2 years ago
- This is an official implementation for "ResT: An Efficient Transformer for Visual Recognition".☆282Updated 2 years ago
- 1.5−3.0× lossless training or pre-training speedup. An off-the-shelf, easy-to-implement algorithm for the efficient training of foundatio…☆217Updated 5 months ago
- ☆191Updated 2 years ago
- ConvMAE: Masked Convolution Meets Masked Autoencoders☆491Updated last year