Alternatives and similar repositories for LLaMA-MoE-v2

Users that are interested in LLaMA-MoE-v2 are comparing it to the libraries listed below

• SUSTechBruce / LOOK-M
  [EMNLP 2024 Findings🔥] Official implementation of ": LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context In…
  ☆104Updated last year
• OpenSparseLLMs / MoM
  ☆106Updated 2 months ago
• hemingkx / TokenSkip
  [EMNLP 2025] TokenSkip: Controllable Chain-of-Thought Compression in LLMs
  ☆189Updated 4 months ago
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆87Updated 9 months ago
• hkust-nlp / Laser
  Laser: Learn to Reason Efficiently with Adaptive Length-based Reward Shaping
  ☆59Updated 5 months ago
• hkust-nlp / mstar
  [ICML 2025] M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning
  ☆69Updated 4 months ago
• LINs-lab / DynMoE
  [ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models
  ☆143Updated 4 months ago
• ShadeCloak / ADORA
  ☆46Updated 7 months ago
• hahahawu / Long-to-Short-via-Model-Merging
  Model merging is a highly efficient approach for long-to-short reasoning.
  ☆89Updated last month
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆109Updated 5 months ago
• xiaomi-research / colar
  [NeurIPS 2025] Think Silently, Think Fast: Dynamic Latent Compression of LLM Reasoning Chains
  ☆59Updated 3 months ago
• MileBench / MileBench
  This repo contains evaluation code for the paper "MileBench: Benchmarking MLLMs in Long Context"
  ☆35Updated last year
• MingyuJ666 / Rope_with_LLM
  [ICML'25] Our study systematically investigates massive values in LLMs' attention mechanisms. First, we observe massive values are concen…
  ☆80Updated 4 months ago
• xuyige / SoftCoT
  ACL'2025: SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMs. and preprint: SoftCoT++: Test-Time Scaling with Soft Chain-of…
  ☆61Updated 5 months ago
• fscdc / Awesome-Efficient-Reasoning-Models
  [TMLR 2025] Efficient Reasoning Models: A Survey
  ☆276Updated 3 weeks ago
• lzhxmu / VTW
  Code release for VTW (AAAI 2025 Oral)
  ☆61Updated 2 weeks ago
• ThinkMorph / ThinkMorph
  The official repository for the paper "ThinkMorph: Emergent Properties in Multimodal Interleaved Chain-of-Thought Reasoning"
  ☆96Updated this week
• OpenSparseLLMs / Open-Pandora
  Open-Pandora: On-the-fly Control Video Generation
  ☆35Updated 11 months ago
• qiuzh20 / gated_attention
  The official implementation for [NeurIPS2025 Oral] Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink…
  ☆105Updated 2 months ago
• Dereck0602 / Awesome_Test_Time_LLMs
  ☆131Updated 8 months ago
• zjunlp / LightThinker
  [EMNLP 2025] LightThinker: Thinking Step-by-Step Compression
  ☆123Updated 7 months ago
• IAAR-Shanghai / xVerify
  xVerify: Efficient Answer Verifier for Reasoning Model Evaluations
  ☆138Updated this week
• zzzhr97 / SpecBench
  ☆22Updated 3 weeks ago
• NUS-TRAIL / NoisyRollout
  [NeurIPS 2025] NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation
  ☆97Updated 2 months ago
• InfiMM / Awesome-Multimodal-LLM-for-Math-STEM
  Paper collections of multi-modal LLM for Math/STEM/Code.
  ☆129Updated this week
• THU-KEG / AdaptThink
  ☆165Updated last month
• ssmisya / PRMBench
  [ACL' 25] The official code repository for PRMBench: A Fine-grained and Challenging Benchmark for Process-Level Reward Models.
  ☆84Updated 9 months ago
• TEAM-ARM / arm
  [NeurIPS'25 Spotlight] ARM: Adaptive Reasoning Model
  ☆56Updated 3 weeks ago
• UCSB-NLP-Chang / ThinkPrune
  ☆45Updated last month
• bigai-nlco / LatentSeek
  Official Repository of LatentSeek
  ☆67Updated 5 months ago