[ICLR 2023] "More ConvNets in the 2020s: Scaling up Kernels Beyond 51x51 using Sparsity"; [ICML 2023] "Are Large Kernels Better Teachers than Transformers for ConvNets?"
☆284Jul 5, 2023Updated 2 years ago
Alternatives and similar repositories for SLaK
Users that are interested in SLaK are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Scaling Up Your Kernels to 31x31: Revisiting Large Kernel Design in CNNs (CVPR 2022)☆941Apr 24, 2024Updated last year
- Official MegEngine implementation of RepLKNet☆286Apr 17, 2022Updated 3 years ago
- [NeurIPS 2022] HorNet: Efficient High-Order Spatial Interactions with Recursive Gated Convolutions☆346Dec 30, 2025Updated 2 months ago
- InceptionNeXt: When Inception Meets ConvNeXt (CVPR 2024)☆346Dec 2, 2024Updated last year
- Code release for ConvNeXt V2 model☆1,991Aug 14, 2024Updated last year
- ☆821Jul 30, 2022Updated 3 years ago
- Code release for ConvNeXt model☆6,319Jan 8, 2023Updated 3 years ago
- [ICME 2022] code for the paper, SimVit: Exploring a simple vision transformer with sliding windows.☆67Oct 11, 2022Updated 3 years ago
- MetaFormer Baselines for Vision (TPAMI 2024)☆495Jun 1, 2024Updated last year
- ConvMAE: Masked Convolution Meets Masked Autoencoders☆523Mar 14, 2023Updated 3 years ago
- Official PyTorch implementation of Fully Attentional Networks☆481Mar 31, 2023Updated 2 years ago
- PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)☆1,366Jun 1, 2024Updated last year
- Neighborhood Attention Transformer, arxiv 2022 / CVPR 2023. Dilated Neighborhood Attention Transformer, arxiv 2022☆1,176May 15, 2024Updated last year
- [ICML 2023] Official PyTorch implementation of Global Context Vision Transformers☆447Dec 22, 2023Updated 2 years ago
- Official Pytorch implementations for "SegNeXt: Rethinking Convolutional Attention Design for Semantic Segmentation" (NeurIPS 2022)☆869Nov 22, 2022Updated 3 years ago
- [ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, De…☆45Nov 11, 2023Updated 2 years ago
- [NeurIPS 2021] [T-PAMI] Global Filter Networks for Image Classification☆505Jun 12, 2023Updated 2 years ago
- [ICLR 2022] The Unreasonable Effectiveness of Random Pruning: Return of the Most Naive Baseline for Sparse Training by Shiwei Liu, Tianlo…☆77Jan 9, 2023Updated 3 years ago
- Official Pytorch Implementation of "Outlier-weighed Layerwise Sampling for LLM Fine-tuning" by Pengxiang Li, Lu Yin, Xiaowei Gao, Shiwei …☆35Jun 3, 2025Updated 9 months ago
- Open-source code for Generic Grouping Network (GGN, CVPR 2022)☆114Mar 2, 2026Updated 3 weeks ago
- [ICLR'22 Oral] Implementation of "CycleMLP: A MLP-like Architecture for Dense Prediction"☆292Apr 25, 2022Updated 3 years ago
- Code release for "Dropout Reduces Underfitting"☆316May 6, 2023Updated 2 years ago
- RepVGG: Making VGG-style ConvNets Great Again☆3,464Feb 10, 2023Updated 3 years ago
- [Preprint] ConvMLP: Hierarchical Convolutional MLPs for Vision, 2021☆167Oct 11, 2022Updated 3 years ago
- Code repository for the ICLR 2022 paper "FlexConv: Continuous Kernel Convolutions With Differentiable Kernel Sizes" https://openreview.ne…☆116Nov 30, 2022Updated 3 years ago
- iFormer: Inception Transformer☆248Jan 14, 2023Updated 3 years ago
- Pytorch implementation of Mix-Shifting-MLP (MS-MLP)☆16Feb 16, 2022Updated 4 years ago
- Repository of Vision Transformer with Deformable Attention (CVPR2022) and DAT++: Spatially Dynamic Vision Transformerwith Deformable Atte…☆926Apr 17, 2024Updated last year
- The official implementation of ELSA: Enhanced Local Self-Attention for Vision Transformer☆116Aug 30, 2023Updated 2 years ago
- [ICLR 2022] "Deep Ensembling with No Overhead for either Training or Testing: The All-Round Blessings of Dynamic Sparsity" by Shiwei Liu,…☆27Jun 15, 2022Updated 3 years ago
- 'NKD and USKD' (ICCV 2023) and 'ViTKD' (CVPRW 2024)☆244Oct 10, 2023Updated 2 years ago
- VOLO: Vision Outlooker for Visual Recognition☆950Sep 18, 2022Updated 3 years ago
- [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "Fast Vision Transformers with HiLo Attention"☆299Nov 17, 2023Updated 2 years ago
- ☆187Jan 2, 2025Updated last year
- This is a PyTorch implementation of “Context AutoEncoder for Self-Supervised Representation Learning"☆197Jan 11, 2023Updated 3 years ago
- EfficientFormerV2 [ICCV 2023] & EfficientFormer [NeurIPs 2022]☆1,111Aug 13, 2023Updated 2 years ago
- [ECCV 2022] Source code of "EdgeFormer: Improving Light-weight ConvNets by Learning from Vision Transformers"☆357Dec 14, 2022Updated 3 years ago
- ☆110Sep 15, 2021Updated 4 years ago
- [ECCV 2022] Official repository for "MaxViT: Multi-Axis Vision Transformer". SOTA foundation models for classification, detection, segmen…☆489Jun 2, 2023Updated 2 years ago