xinghaochen / SLAB
[ICML 2024] Official PyTorch implementation of "SLAB: Efficient Transformers with Simplified Linear Attention and Progressive Re-parameterized Batch Normalization"
☆88Updated 5 months ago
Alternatives and similar repositories for SLAB:
Users that are interested in SLAB are comparing it to the libraries listed below
- ☆83Updated last year
- [CVPR 2024] SHViT: Single-Head Vision Transformer with Memory Efficient Macro Design☆87Updated 8 months ago
- The official project website of "KernelWarehouse: Rethinking the Design of Dynamic Convolution" (KW for short, published in ICML 2024)☆96Updated 8 months ago
- Code Implementation of EfficientVMamba☆194Updated 10 months ago
- ☆55Updated 11 months ago
- Code for paper LocalMamba: Visual State Space Model with Windowed Selective Scan☆226Updated 9 months ago
- ☆171Updated last month
- [ICLR2025] Spatial-Mamba: Effective Visual State Space Models via Structure-Aware State Fusion☆76Updated 3 months ago
- ☆72Updated last year
- [BMVC 2024] PlainMamba: Improving Non-hierarchical Mamba in Visual Recognition☆72Updated 6 months ago
- Vision Mamba 2: More Efficient Visual Representation Learning with State Space Duality☆27Updated 8 months ago
- Official repository of Slide-Transformer (CVPR2023)☆161Updated 5 months ago
- GroupMixAttention and GroupMixFormer☆115Updated last year
- [NeurIPS2024 Spotlight] The official implementation of GrootVL: Tree Topology is All You Need in State Space Model☆89Updated 8 months ago
- (CVPR2024)RMT: Retentive Networks Meet Vision Transformer☆325Updated 6 months ago
- [ICLR 2024 poster] Efficient Modulation for Vision Networks☆51Updated 7 months ago
- Orthogonal Channel Attentions Networks☆50Updated last year
- [NeurIPS2024] Multi-Scale VMamba: Hierarchy in Hierarchy Visual State Space Model☆58Updated last month
- [ICCV2023] This is an official implementation for "Scale-Aware Modulation Meet Transformer".☆197Updated last year
- The official code of "Rethinking Local Perception in Lightweight Vision Transformer"☆85Updated last year
- PyTorch code and checkpoints release for VanillaKD: https://arxiv.org/abs/2305.15781☆74Updated last year
- ☆135Updated 5 months ago
- CMT Pytorch implementation of our CVPR 2022 paper CMT: Convolutional Neural Networks Meet Vision Transformers (https://arxiv.org/pdf/2107…☆95Updated 2 years ago
- Official repository of MLLA (NeurIPS 2024)☆271Updated 2 months ago
- Introduce Mamba2 to Vision.☆114Updated 5 months ago
- TransXNet: Learning Both Global and Local Dynamics with a Dual Dynamic Token Mixer for Visual Recognition☆170Updated last year
- Vision Mamba: A Comprehensive Survey and Taxonomy☆83Updated 5 months ago
- Scattering Vision Transformer☆50Updated 11 months ago
- Official repository of FLatten Transformer (ICCV2023)☆410Updated 3 months ago
- ☆59Updated last year