Alternatives and similar repositories for mamba4transformers

Users that are interested in mamba4transformers are comparing it to the libraries listed below

• hkgc-1 / GHPO
  ☆57Updated 5 months ago
• USTC-StarTeam / ZIP
  ☆26Updated last year
• AwesomeSeq / Comba-triton
  ☆49Updated 6 months ago
• waltonfuture / Diff-eRank
  [NeurIPS 2024] A Novel Rank-Based Metric for Evaluating Large Language Models
  ☆56Updated 7 months ago
• Zanette-Labs / SpeculativeRejection
  [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection
  ☆53Updated last year
• starrYYxuan / LeCo
  This the implementation of LeCo
  ☆31Updated 11 months ago
• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆40Updated last year
• Wangmerlyn / MCTS-GSM8k-Demo
  This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems
  ☆94Updated last month
• YangLing0818 / SuperCorrect-llm
  [ICLR 2025] SuperCorrect: Advancing Small LLM Reasoning with Thought Template Distillation and Self-Correction
  ☆86Updated 9 months ago
• ZhenweiAn / Dynamic_MoE
  Inference Code for Paper "Harder Tasks Need More Experts: Dynamic Routing in MoE Models"
  ☆67Updated last year
• snu-mllab / Context-Memory
  Pytorch implementation for "Compressed Context Memory For Online Language Model Interaction" (ICLR'24)
  ☆62Updated last year
• Open-Source-O1 / o1_Reasoning_Patterns_Study
  ☆104Updated last year
• UbiquantAI / one-shot-em
  One-shot Entropy Minimization
  ☆187Updated 6 months ago
• YeFD / RRAG
  The official Github repository for paper "R^2AG: Incorporating Retrieval Information into Retrieval Augmented Generation" (EMNLP 2024 Fin…
  ☆38Updated last year
• Raibows / CREAM
  Code for "CREAM: Consistency Regularized Self-Rewarding Language Models", ICLR 2025.
  ☆28Updated 10 months ago
• RUCAIBox / EASYEP
  ☆25Updated 8 months ago
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆138Updated last year
• codefuse-ai / Collinear-Constrained-Attention
  ☆62Updated last year
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆88Updated 10 months ago
• OpenSparseLLMs / Linear-MoE
  ☆126Updated 7 months ago
• SkyworkAI / skywork-o1-prm-inference
  ☆65Updated last year
• zhaochenyang20 / Prompt2Model-Self-Guide
  SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper
  ☆32Updated last year
• Chaos96 / fourierft
  ☆152Updated last year
• efficientscaling / Z1
  [EMNLP'25 Industry] Repo for "Z1: Efficient Test-time Scaling with Code"
  ☆68Updated 9 months ago
• DIRECT-BIT / SRA-MCTS
  ☆32Updated 7 months ago
• assafbk / DeciMamba
  DeciMamba: Exploring the Length Extrapolation Potential of Mamba (ICLR 2025)
  ☆32Updated 9 months ago
• thu-coai / SPaR
  ☆46Updated 7 months ago
• AIFrameResearch / SPO
  Segment Policy Optimization: Effective Segment-Level Credit Assignment in RL for Large Language Models
  ☆44Updated 3 months ago
• kyegomez / Mixture-of-Depths
  Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆111Updated last month
• BICLab / MetaLA
  Offical implementation of "MetaLA: Unified Optimal Linear Approximation to Softmax Attention Map" (NeurIPS2024 Oral)
  ☆33Updated 11 months ago