Alternatives and similar repositories for mamba-notes

Users that are interested in mamba-notes are comparing it to the libraries listed below

• AmeenAli / HiddenMambaAttn
  Official PyTorch Implementation of "The Hidden Attention of Mamba Models"
  ☆232Updated 2 months ago
• pengzhangzhi / Awesome-Mamba
  Awesome list of papers that extend Mamba to various applications.
  ☆139Updated 7 months ago
• AvivBick / awesome-ssm-ml
  Reading list for research topics in state-space models
  ☆342Updated 7 months ago
• kyegomez / Jamba
  PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
  ☆203Updated last week
• radarFudan / Awesome-state-space-models
  Collection of papers on state-space models
  ☆614Updated 2 months ago
• xmindflow / Awesome_Mamba
  Computation-Efficient Era: A Comprehensive Survey of State Space Models in Medical Image Analysis
  ☆262Updated 5 months ago
• tommyip / mamba2-minimal
  Minimal Mamba-2 implementation in PyTorch
  ☆240Updated last year
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆212Updated this week
• goombalab / hydra
  Official implementation of "Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers"
  ☆170Updated 11 months ago
• kyegomez / Mixture-of-Depths
  Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆111Updated last month
• qiuzh20 / gated_attention
  The official implementation for [NeurIPS2025 Oral] Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink…
  ☆772Updated 3 weeks ago
• kyegomez / SwitchTransformers
  Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficien…
  ☆135Updated this week
• test-time-training / ttt-lm-jax
  Official JAX implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States
  ☆445Updated 2 months ago
• Hprairie / Bi-Mamba2
  A Triton Kernel for incorporating Bi-Directionality in Mamba2
  ☆76Updated last year
• lucidrains / soft-moe-pytorch
  Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch
  ☆340Updated 9 months ago
• tensorgi / TPA
  [NeurIPS 2025 Spotlight] TPA: Tensor ProducT ATTenTion Transformer (T6) (https://arxiv.org/abs/2501.06425)
  ☆443Updated 3 weeks ago
• XiudingCai / Awesome-Mamba-Collection
  A curated collection of papers, tutorials, videos, and other valuable resources related to Mamba.
  ☆693Updated 4 months ago
• PeaBrane / mamba-tiny
  Simple, minimal implementation of the Mamba SSM in one pytorch file. Using logcumsumexp (Heisen sequence).
  ☆128Updated last year
• kyegomez / MoE-Mamba
  Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Ze…
  ☆119Updated 2 months ago
• badripatro / simba
  Simba
  ☆215Updated last year
• apple / ml-sigmoid-attention
  ☆304Updated 8 months ago
• jxiw / MambaInLlama
  [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models
  ☆234Updated 2 months ago
• Event-AHU / Mamba_State_Space_Model_Paper_List
  [Mamba-Survey-2024] Paper list for State-Space-Model/Mamba and it's Applications
  ☆746Updated 6 months ago
• kyegomez / zeta
  Build high-performance AI models with modular building blocks
  ☆577Updated last week
• kyegomez / Griffin
  Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"
  ☆56Updated 2 months ago
• Dao-AILab / causal-conv1d
  Causal depthwise conv1d in CUDA, with a PyTorch interface
  ☆694Updated 2 weeks ago
• kyegomez / VisionMamba
  Implementation of Vision Mamba from the paper: "Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Mod…
  ☆481Updated 3 weeks ago
• kyegomez / Vit-RGTS
  Open source implementation of "Vision Transformers Need Registers"
  ☆206Updated this week
• nanowell / Differential-Transformer-PyTorch
  PyTorch implementation of the Differential-Transformer architecture for sequence modeling, specifically tailored as a decoder-only model …
  ☆85Updated last year
• NVlabs / GatedDeltaNet
  [ICLR 2025] Official PyTorch Implementation of Gated Delta Networks: Improving Mamba2 with Delta Rule
  ☆415Updated 3 months ago