Alternatives and similar repositories for Mamba-R1:

Users that are interested in Mamba-R1 are comparing it to the libraries listed below

• kyegomez / OpenStrawberry
  An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO
  ☆28Updated 3 weeks ago
• kyegomez / MobileVLM
  Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …
  ☆15Updated last year
• KempnerInstitute / traveling-waves-integrate
  Repository to create traveling waves integrate special information through time
  ☆49Updated 3 weeks ago
• leloykun / modded-nanogpt
  NanoGPT (124M) quality in 2.67B tokens
  ☆28Updated last month
• kyegomez / TinyGPTV
  Simple Implementation of TinyGPTV in super simple Zeta lego blocks
  ☆16Updated 4 months ago
• joey00072 / Attention-as-graph
  alternative way to calculating self attention
  ☆18Updated 10 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆39Updated last month
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆45Updated 8 months ago
• catid / lllm
  Latent Large Language Models
  ☆17Updated 7 months ago
• kyegomez / FastFF
  Zeta implementation of a reusable and plug in and play feedforward from the paper "Exponentially Faster Language Modeling"
  ☆15Updated 4 months ago
• ZihanWang314 / coeCheck
  ☆16Updated 3 weeks ago
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆36Updated last year
• facebookresearch / DIG-In
  This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.
  ☆20Updated 9 months ago
• kyegomez / MultiQueryAttention
  This is a simple torch implementation of the high performance Multi-Query Attention
  ☆16Updated last year
• VITA-Group / WeLore
  From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…
  ☆44Updated 8 months ago
• kyegomez / SoundStream
  Implementation of SoundtStream from the paper: "SoundStream: An End-to-End Neural Audio Codec"
  ☆12Updated 2 months ago
• Weixin-Liang / Mixture-of-Mamba
  ☆40Updated 2 months ago
• NathanGodey / qfilters
  Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)
  ☆26Updated 3 weeks ago
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆17Updated 2 weeks ago
• menhguin / minp_paper
  Code Implementation, Evaluations, Documentation, Links and Resources for Min P paper
  ☆28Updated 2 weeks ago
• RWKV / ZeroCoT
  https://x.com/BlinkDL_AI/status/1884768989743882276
  ☆27Updated last month
• diicellman / dynamite-dogs
  BH hackathon
  ☆14Updated 11 months ago
• nanowell / Q-Sparse-LLM
  My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
  ☆31Updated 7 months ago
• kyegomez / TTL
  Pytorch Implementation of the paper: "Learning to (Learn at Test Time): RNNs with Expressive Hidden States"
  ☆24Updated 2 weeks ago
• lucidrains / transformer-lm-gan
  Explorations into adversarial losses on top of autoregressive loss for language modeling
  ☆35Updated last month
• IST-DASLab / QuEST
  Work in progress.
  ☆50Updated 2 weeks ago
• superagi / Veagle
  Enhancement in Multimodal Representation Learning.
  ☆40Updated last year
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆87Updated 2 months ago
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆97Updated 6 months ago
• OpenNLPLab / HGRN2
  HGRN2: Gated Linear RNNs with State Expansion
  ☆53Updated 7 months ago