Hprairie / Bi-Mamba2
A Triton Kernel for incorporating Bi-Directionality in Mamba2
☆65Updated 4 months ago
Alternatives and similar repositories for Bi-Mamba2:
Users that are interested in Bi-Mamba2 are comparing it to the libraries listed below
- Official implementation of "Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers"☆130Updated 3 months ago
- Official PyTorch Implementation of "The Hidden Attention of Mamba Models"☆217Updated 11 months ago
- An efficient pytorch implementation of selective scan in one file, works with both cpu and gpu, with corresponding mathematical derivatio…☆86Updated last year
- Awesome list of papers that extend Mamba to various applications.☆132Updated last month
- DeciMamba: Exploring the Length Extrapolation Potential of Mamba (ICLR 2025)☆26Updated 3 weeks ago
- ☆58Updated 3 months ago
- Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"☆53Updated last month
- Ofiicial Implementation for Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data☆59Updated 10 months ago
- A repository for DenseSSMs☆87Updated last year
- [ICLR 2025] Official Code Release for Explaining Modern Gated-Linear RNNs via a Unified Implicit Attention Formulation☆42Updated 2 months ago
- Minimal Mamba-2 implementation in PyTorch☆191Updated 10 months ago
- [ICLR 2025] Official PyTorch Implementation of Gated Delta Networks: Improving Mamba2 with Delta Rule☆159Updated last month
- More dimensions = More fun☆22Updated 9 months ago
- This repository is the official implementation of our Autoregressive Pretraining with Mamba in Vision☆77Updated 10 months ago
- Official implementation of Phi-Mamba. A MOHAWK-distilled model (Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Mode…☆106Updated 7 months ago
- Introduce Mamba2 to Vision.☆126Updated 8 months ago
- Implementation of Agent Attention in Pytorch☆89Updated 9 months ago
- PyTorch implementation of the Differential-Transformer architecture for sequence modeling, specifically tailored as a decoder-only model …☆59Updated 6 months ago
- State Space Models☆67Updated last year
- [CVPR2025] Breaking the Low-Rank Dilemma of Linear Attention☆17Updated last month
- Simba☆206Updated last year
- [NeurIPS 2024] Official implementation of the paper "MambaLRP: Explaining Selective State Space Sequence Models".☆38Updated 6 months ago
- ☆65Updated 6 months ago
- ☆48Updated last year
- Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch☆103Updated 5 months ago
- Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling☆191Updated last month
- HGRN2: Gated Linear RNNs with State Expansion☆54Updated 8 months ago
- Causal depthwise conv1d in CUDA, with a PyTorch interface☆442Updated 5 months ago
- A simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Transformer for Large Language Models" (http…☆105Updated last year
- ☆40Updated 3 months ago