MzeroMiko / mamba-mini
An efficient pytorch implementation of selective scan in one file, works with both cpu and gpu, with corresponding mathematical derivation. It is probably the code which is the most close to selective_scan_cuda in mamba.
☆71Updated 8 months ago
Related projects ⓘ
Alternatives and complementary repositories for mamba-mini
- Vision-RWKV: Efficient and Scalable Visual Perception with RWKV-Like Architectures☆371Updated 3 weeks ago
- Code Implementation of EfficientVMamba☆183Updated 7 months ago
- Awesome list of papers that extend Mamba to various applications.☆128Updated 2 months ago
- [CVPR'24] Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities☆94Updated 8 months ago
- A Triton Kernel for incorporating Bi-Directionality in Mamba2☆50Updated 2 months ago
- The official repo for [TPAMI'23] "Vision Transformer with Quadrangle Attention"☆177Updated 7 months ago
- Code for paper LocalMamba: Visual State Space Model with Windowed Selective Scan☆204Updated 6 months ago
- Open source implementation of "Vision Transformers Need Registers"☆143Updated last week
- Official implementation of "Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers"☆103Updated 3 months ago
- Official repository of MLLA (NeurIPS 2024)☆217Updated this week
- [ECCV 2024] Official PyTorch implementation of RoPE-ViT "Rotary Position Embedding for Vision Transformer"☆213Updated 3 weeks ago
- Introduce Mamba2 to Vision.☆93Updated 2 months ago
- This repository is the official implementation of our Autoregressive Pretraining with Mamba in Vision☆64Updated 5 months ago
- [NeurIPS2024 Spotlight] The official implementation of GrootVL: Tree Topology is All You Need in State Space Model☆83Updated 5 months ago
- Causal depthwise conv1d in CUDA, with a PyTorch interface☆329Updated 3 months ago
- Official PyTorch Implementation of "The Hidden Attention of Mamba Models"☆200Updated 5 months ago
- A repository for DenseSSMs☆88Updated 7 months ago
- ☆48Updated 5 months ago
- A curated list of papers on the applications of RWKV in computer vision.☆112Updated 2 weeks ago
- ☆102Updated 4 months ago
- [ICML 2024] Official PyTorch implementation of "SLAB: Efficient Transformers with Simplified Linear Attention and Progressive Re-paramete…☆79Updated 2 months ago
- ✨✨Latest Papers on Vision Mamba and Related Areas☆237Updated 2 weeks ago
- Mamba in Vision: A Comprehensive Survey of Techniques and Applications☆70Updated last month
- Ofiicial Implementation for Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data☆50Updated 4 months ago
- A PyTorch implementation of the paper "ZigMa: A DiT-Style Mamba-based Diffusion Model" (ECCV 2024)☆275Updated this week
- ☆75Updated last year
- Implementation of ViTaR: ViTAR: Vision Transformer with Any Resolution in PyTorch☆25Updated last week
- ☆112Updated 5 months ago
- [BMVC 2024] PlainMamba: Improving Non-hierarchical Mamba in Visual Recognition☆70Updated 3 months ago
- The official implementation of DiM: Diffusion Mamba for Efficient High-Resolution Image Synthesis☆158Updated 4 months ago