Alternatives and similar repositories for mamba4transformers

Users that are interested in mamba4transformers are comparing it to the libraries listed below

• waltonfuture / Diff-eRank
  [NeurIPS 2024] A Novel Rank-Based Metric for Evaluating Large Language Models
  ☆50Updated last month
• kyegomez / Mixture-of-Depths
  Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆103Updated last week
• starrYYxuan / LeCo
  This the implementation of LeCo
  ☆31Updated 6 months ago
• USTC-StarTeam / ZIP
  ☆23Updated last year
• Wangmerlyn / MCTS-GSM8k-Demo
  This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems
  ☆85Updated 4 months ago
• YangLing0818 / SuperCorrect-llm
  [ICLR 2025] SuperCorrect: Advancing Small LLM Reasoning with Thought Template Distillation and Self-Correction
  ☆74Updated 4 months ago
• codefuse-ai / Collinear-Constrained-Attention
  ☆63Updated last year
• nishiwen1214 / Benchmark-leakage-detection
  Official completion of “Training on the Benchmark Is Not All You Need”.
  ☆35Updated 6 months ago
• RUCKBReasoning / CoT-based-Synthesizer
  Official code implementation for the ACL 2025 paper: 'CoT-based Synthesizer: Enhancing LLM Performance through Answer Synthesis'
  ☆27Updated 2 months ago
• abdelfattah-lab / SplitReason
  ☆18Updated 3 weeks ago
• THUDM / T1
  RL Scaling and Test-Time Scaling (ICML'25)
  ☆109Updated 6 months ago
• Infini-AI-Lab / Multiverse
  ☆75Updated 2 weeks ago
• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆38Updated 9 months ago
• OpenSparseLLMs / Linear-MoE
  ☆112Updated last month
• AwesomeSeq / Comba-triton
  ☆45Updated last month
• TsinghuaC3I / Fourier-Position-Embedding
  [ICML 2025] Fourier Position Embedding: Enhancing Attention’s Periodic Extension for Length Generalization
  ☆81Updated last month
• sail-sg / sdft
  [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".
  ☆124Updated 8 months ago
• KaihuaTang / Qwen-Tokenizer-Pruner
  Due to the huge vocaburary size (151,936) of Qwen models, the Embedding and LM Head weights are excessively heavy. Therefore, this projec…
  ☆23Updated 11 months ago
• RyanLiu112 / GenPRM
  Official codebase for "GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning".
  ☆80Updated last month
• Dereck0602 / Awesome_Test_Time_LLMs
  ☆116Updated 4 months ago
• ZhenweiAn / Dynamic_MoE
  Inference Code for Paper "Harder Tasks Need More Experts: Dynamic Routing in MoE Models"
  ☆58Updated 11 months ago
• AIFlowPlayer / SentenceVAE
  Enable Next-sentence Prediction for Large Language Models with Faster Speed, Higher Accuracy and Longer Context
  ☆35Updated 11 months ago
• EffiVLM-Bench / EffiVLM-Bench
  ☆18Updated last month
• OpenSparseLLMs / Linearization
  ☆52Updated 2 weeks ago
• GraphPKU / Case_or_Rule
  exploring whether LLMs perform case-based or rule-based reasoning
  ☆29Updated last year
• wenyudu / MIGU
  [EMNLP 2024 Findings] Unlocking Continual Learning Abilities in Language Models
  ☆25Updated 9 months ago
• multimodal-art-projection / LatentCoT-Horizon
  📖 This is a repository for organizing papers, codes, and other resources related to Latent Reasoning.
  ☆145Updated this week
• OpenSparseLLMs / MoM
  ☆91Updated 3 months ago
• hkust-nlp / mstar
  [ICML 2025] M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning
  ☆63Updated last week
• DIRECT-BIT / SRA-MCTS
  ☆33Updated last month