Alternatives and similar repositories for mamba4transformers:

Users that are interested in mamba4transformers are comparing it to the libraries listed below

• waltonfuture / Diff-eRank
  [NeurIPS 2024] A Novel Rank-Based Metric for Evaluating Large Language Models
  ☆45Updated 5 months ago
• RyanLiu112 / GenPRM
  Official codebase for "GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning".
  ☆70Updated this week
• USTC-StarTeam / ZIP
  ☆22Updated 9 months ago
• kyegomez / MoE-Mamba
  Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Ze…
  ☆103Updated 3 weeks ago
• GraphPKU / Case_or_Rule
  exploring whether LLMs perform case-based or rule-based reasoning
  ☆28Updated last year
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆65Updated 2 months ago
• starrYYxuan / LeCo
  This the implementation of LeCo
  ☆32Updated 3 months ago
• Gabesarch / ICAL
  ☆36Updated 2 months ago
• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆37Updated 6 months ago
• LightChen233 / reasoning-boundary
  ☆55Updated 6 months ago
• Chaos96 / fourierft
  ☆144Updated 7 months ago
• ZhenweiAn / Dynamic_MoE
  Inference Code for Paper "Harder Tasks Need More Experts: Dynamic Routing in MoE Models"
  ☆46Updated 8 months ago
• WailordHe / DenseSSM
  A repository for DenseSSMs
  ☆87Updated last year
• sanowl / OmegaPRM
  this is an implementation for the paper Improve Mathematical Reasoning in Language Models by Automated Process Supervision from google de…
  ☆28Updated 3 weeks ago
• kyegomez / Mixture-of-Depths
  Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆91Updated last week
• zuucan / NeedleInAHaystack-PLUS
  To assess the longtext capabilities more comprehensively, we propose Needle-in-a-Haystack PLUS, which shifts the focus from simple fact r…
  ☆11Updated last year
• THUDM / Self-Contrast
  Extensive Self-Contrast Enables Feedback-Free Language Model Alignment
  ☆20Updated last year
• YangLing0818 / SuperCorrect-llm
  [ICLR 2025] SuperCorrect: Advancing Small LLM Reasoning with Thought Template Distillation and Self-Correction
  ☆68Updated last month
• cs-holder / Reasoning-Self-Evolution-Survey
  ☆40Updated last month
• Dereck0602 / Awesome_Test_Time_LLMs
  ☆94Updated last month
• FreedomIntelligence / TinyDeepSeek
  Reproduction of the complete process of DeepSeek-R1 on small-scale models, including Pre-training, SFT, and RL.
  ☆22Updated last month
• THUDM / Awesome-Parameter-Efficient-Fine-Tuning-for-Foundation-Models
  Parameter-Efficient Fine-Tuning for Foundation Models
  ☆57Updated 3 weeks ago
• njucckevin / MM-Self-Improve
  A Self-Training Framework for Vision-Language Reasoning
  ☆76Updated 3 months ago
• Raibows / CREAM
  Code for "CREAM: Consistency Regularized Self-Rewarding Language Models", ICLR 2025.
  ☆20Updated 2 months ago
• Wangmerlyn / MCTS-GSM8k-Demo
  This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems
  ☆74Updated last month
• GCYZSL / MoLA
  ☆132Updated 9 months ago
• Weixin-Liang / Mixture-of-Mamba
  ☆40Updated 3 months ago
• RUCKBReasoning / CoT-based-Synthesizer
  The code of arxiv paper: "CoT-based Synthesizer: Enhancing LLM Performance through Answer Synthesis"
  ☆24Updated 3 months ago
• efficientscaling / Z1
  Repo for "Z1: Efficient Test-time Scaling with Code"
  ☆55Updated 2 weeks ago
• wutaiqiang / MoSLoRA
  ☆100Updated 9 months ago