Alternatives and similar repositories for phi-mamba

Users that are interested in phi-mamba are comparing it to the libraries listed below

• goombalab / hydra

  View on GitHub
  Official implementation of "Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers"
  ☆169Jan 30, 2025Updated last year
• jxiw / MambaInLlama

  View on GitHub
  [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models
  ☆236Oct 14, 2025Updated 3 months ago
• Doraemonzzz / Awesome-Triton-Resources

  View on GitHub
  Awesome Triton Resources
  ☆39Apr 27, 2025Updated 9 months ago
• Cranial-XIX / longhorn

  View on GitHub
  Official PyTorch Implementation of the Longhorn Deep State Space Model
  ☆56Dec 4, 2024Updated last year
• foundation-model-stack / bamba

  View on GitHub
  Train, tune, and infer Bamba model
  ☆137Jun 4, 2025Updated 8 months ago
• sjelassi / transformers_ssm_copy

  View on GitHub
  ☆35Feb 26, 2024Updated last year
• IBM / selective-dense-state-space-model

  View on GitHub
  Open-sourcing code associated with the AAAI-25 paper "On the Expressiveness and Length Generalization of Selective State-Space Models on …
  ☆14Sep 18, 2025Updated 4 months ago
• Hprairie / Bi-Mamba2

  View on GitHub
  A Triton Kernel for incorporating Bi-Directionality in Mamba2
  ☆78Dec 18, 2024Updated last year
• KimHanjung / VISAGE

  View on GitHub
  [ECCV 2024] VISAGE: Video Instance Segmentation with Appearance-Guided Enhancement
  ☆36Jul 29, 2024Updated last year
• OpenSparseLLMs / MoM

  View on GitHub
  ☆120Feb 4, 2026Updated last week
• jxiw / MambaByte

  View on GitHub
  [CoLM 24] Official Repository of MambaByte: Token-free Selective State Space Model
  ☆24Oct 12, 2024Updated last year
• Zyphra / Zamba2

  View on GitHub
  PyTorch implementation of models from the Zamba2 series.
  ☆186Jan 23, 2025Updated last year
• HazyResearch / zoology

  View on GitHub
  Understand and test language model architectures on synthetic tasks.
  ☆252Jan 12, 2026Updated last month
• proger / nanokitchen

  View on GitHub
  Parallel Associative Scan for Language Models
  ☆18Jan 8, 2024Updated 2 years ago
• sustcsonglin / mamba-triton

  View on GitHub
  ☆51Jan 28, 2024Updated 2 years ago
• assafbk / DeciMamba

  View on GitHub
  DeciMamba: Exploring the Length Extrapolation Potential of Mamba (ICLR 2025)
  ☆32Apr 9, 2025Updated 10 months ago
• NVlabs / GatedDeltaNet

  View on GitHub
  [ICLR 2025] Official PyTorch Implementation of Gated Delta Networks: Improving Mamba2 with Delta Rule
  ☆452Sep 15, 2025Updated 4 months ago
• zhixuan-lin / forgetting-transformer

  View on GitHub
  [ICLR 2025 & COLM 2025] Official PyTorch implementation of the Forgetting Transformer and Adaptive Computation Pruning
  ☆137Dec 19, 2025Updated last month
• automl / is_mamba_capable_of_icl

  View on GitHub
  ☆18Apr 24, 2024Updated last year
• mkhodak / relax

  View on GitHub
  ☆15Jun 22, 2022Updated 3 years ago
• joey00072 / microjax

  View on GitHub
  Jax like function transformation engine but micro, microjax
  ☆34Oct 25, 2024Updated last year
• fla-org / flash-bidirectional-linear-attention

  View on GitHub
  Triton implement of bi-directional (non-causal) linear attention
  ☆65Feb 2, 2026Updated last week
• fla-org / flash-linear-attention

  View on GitHub
  🚀 Efficient implementations of state-of-the-art linear attention models
  ☆4,379Updated this week
• minsu1206 / ExploreGS

  View on GitHub
  [ICCV2025] ExploreGS: Explorable 3D Scene Reconstruction with Virtual Camera Samplings and Diffusion Priors
  ☆53Oct 30, 2025Updated 3 months ago
• srush / annotated-mamba

  View on GitHub
  Annotated version of the Mamba paper
  ☆496Feb 27, 2024Updated last year
• recursal / RADLADS-paper

  View on GitHub
  RADLADS training code
  ☆36May 7, 2025Updated 9 months ago
• kingsj0405 / DIFE

  View on GitHub
  Dense Interspecies Face Embedding (NeurIPS 2022)
  ☆25May 16, 2023Updated 2 years ago
• TRI-ML / linear_open_lm

  View on GitHub
  A repository for research on medium sized language models.
  ☆77May 23, 2024Updated last year
• sukjunhwang / set_classifier

  View on GitHub
  Official PyTorch implementation of: "Cannot See the Forest for the Trees: Aggregating Multiple Viewpoints to Better Classify Objects in V…
  ☆14Aug 29, 2022Updated 3 years ago
• sustcsonglin / disco-pointer

  View on GitHub
  Official Implementation of ACL2023: Don't Parse, Choose Spans! Continuous and Discontinuous Constituency Parsing via Autoregressive Span …
  ☆14Aug 25, 2023Updated 2 years ago
• NonvolatileMemory / flash_attn_gqa

  View on GitHub
  triton ver of gqa flash attn, based on the tutorial
  ☆12Aug 4, 2024Updated last year
• HazyResearch / based

  View on GitHub
  Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"
  ☆248Jun 6, 2025Updated 8 months ago
• recursal / GoldFinch-paper

  View on GitHub
  GoldFinch and other hybrid transformer components
  ☆45Jul 20, 2024Updated last year
• yidingjiang / ado

  View on GitHub
  The repository contains code for Adaptive Data Optimization
  ☆32Dec 9, 2024Updated last year
• leloykun / flash-attention-minimal

  View on GitHub
  Flash Attention in 300-500 lines of CUDA/C++
  ☆36Aug 22, 2025Updated 5 months ago
• guangyliu / LatentOps

  View on GitHub
  Source code of LatentOps
  ☆78Oct 23, 2023Updated 2 years ago
• bdusell / stack-attention

  View on GitHub
  Code for the paper "Stack Attention: Improving the Ability of Transformers to Model Hierarchical Patterns"
  ☆18Mar 15, 2024Updated last year
• musicalOffering / ActionSwitch-release

  View on GitHub
  ☆11Aug 7, 2024Updated last year
• ictnlp / FA-DAT

  View on GitHub
  Official Implementation for the ICLR2023 paper "Fuzzy Alignments in Directed Acyclic Graph for Non-autoregressive Machine Translation"
  ☆13Mar 1, 2023Updated 2 years ago