Alternatives and similar repositories for LLaMA-MoE-v2

Users that are interested in LLaMA-MoE-v2 are comparing it to the libraries listed below

• hemingkx / TokenSkip
  [EMNLP 2025] TokenSkip: Controllable Chain-of-Thought Compression in LLMs
  ☆186Updated 4 months ago
• OpenSparseLLMs / MoM
  ☆104Updated last month
• hkust-nlp / Laser
  Laser: Learn to Reason Efficiently with Adaptive Length-based Reward Shaping
  ☆55Updated 5 months ago
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆86Updated 8 months ago
• hkust-nlp / mstar
  [ICML 2025] M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning
  ☆69Updated 3 months ago
• LINs-lab / DynMoE
  [ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models
  ☆137Updated 3 months ago
• SUSTechBruce / LOOK-M
  [EMNLP 2024 Findings🔥] Official implementation of ": LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context In…
  ☆103Updated 11 months ago
• ShadeCloak / ADORA
  ☆46Updated 6 months ago
• UCSB-NLP-Chang / ThinkPrune
  ☆44Updated last month
• THU-KEG / AdaptThink
  ☆157Updated 2 weeks ago
• Dereck0602 / Awesome_Test_Time_LLMs
  ☆129Updated 7 months ago
• hahahawu / Long-to-Short-via-Model-Merging
  Model merging is a highly efficient approach for long-to-short reasoning.
  ☆89Updated 2 weeks ago
• GCYZSL / MoLA
  ☆161Updated last year
• GeniusHTX / TALE
  ☆133Updated last month
• xiaomi-research / colar
  [NeurIPS 2025] Think Silently, Think Fast: Dynamic Latent Compression of LLM Reasoning Chains
  ☆57Updated 3 months ago
• MingyuJ666 / Rope_with_LLM
  [ICML'25] Our study systematically investigates massive values in LLMs' attention mechanisms. First, we observe massive values are concen…
  ☆80Updated 4 months ago
• OpenSparseLLMs / Open-Pandora
  Open-Pandora: On-the-fly Control Video Generation
  ☆35Updated 11 months ago
• GATECH-EIC / ACT
  [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…
  ☆44Updated last year
• MileBench / MileBench
  This repo contains evaluation code for the paper "MileBench: Benchmarking MLLMs in Long Context"
  ☆35Updated last year
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆109Updated 5 months ago
• bigai-nlco / LatentSeek
  Official Repository of LatentSeek
  ☆66Updated 4 months ago
• aeroplanepaper / GRPO-LEAD
  ☆29Updated last month
• wutaiqiang / MoSLoRA
  ☆120Updated last year
• SihengLi99 / SEALONG
  Large Language Models Can Self-Improve in Long-context Reasoning
  ☆73Updated 11 months ago
• ssmisya / PRMBench
  [ACL' 25] The official code repository for PRMBench: A Fine-grained and Challenging Benchmark for Process-Level Reward Models.
  ☆81Updated 8 months ago
• zzzhr97 / SpecBench
  ☆22Updated 3 weeks ago
• OpenSparseLLMs / Linear-MoE
  ☆120Updated 4 months ago
• yczhou001 / Awesome-Diffusion-LLM
  paper list, tutorial, and nano code snippet for Diffusion Large Language Models.
  ☆122Updated 4 months ago
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆83Updated 11 months ago
• qiuzh20 / gated_attention
  The official implementation for [NeurIPS2025 Oral] Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink…
  ☆99Updated last month