Alternatives and similar repositories for MoE-PEFT

Users that are interested in MoE-PEFT are comparing it to the libraries listed below

• TUDB-Labs / MixLoRA
  State-of-the-art Parameter-Efficient MoE Fine-tuning Method
  ☆163Updated 10 months ago
• hemingkx / TokenSkip
  TokenSkip: Controllable Chain-of-Thought Compression in LLMs
  ☆156Updated 3 months ago
• EIT-NLP / Awesome-Latent-CoT
  This repository contains a regularly updated paper list for LLMs-reasoning-in-latent-space.
  ☆120Updated this week
• GCYZSL / MoLA
  ☆142Updated 11 months ago
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆73Updated 4 months ago
• Blueyee / Efficient-CoT-LRMs
  Chain of Thoughts (CoT) is so hot! so long! We need short reasoning process!
  ☆54Updated 2 months ago
• hahahawu / Long-to-Short-via-Model-Merging
  Model merging is a highly efficient approach for long-to-short reasoning.
  ☆65Updated 3 weeks ago
• Dereck0602 / Awesome_Test_Time_LLMs
  ☆109Updated 3 months ago
• Alsace08 / Chain-of-Embedding
  [ICLR 2025] Code and Data Repo for Paper "Latent Space Chain-of-Embedding Enables Output-free LLM Self-Evaluation"
  ☆64Updated 6 months ago
• xuyige / SoftCoT
  ACL'2025: SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMs. and preprint: SoftCoT++: Test-Time Scaling with Soft Chain-of…
  ☆28Updated 3 weeks ago
• tmlr-group / landscape-of-thoughts
  [ICLR 2025 Workshop] "Landscape of Thoughts: Visualizing the Reasoning Process of Large Language Models"
  ☆25Updated last week
• bethgelab / sober-reasoning
  A Sober Look at Language Model Reasoning
  ☆74Updated last week
• hkust-nlp / dart-math
  [NeurIPS'24] Official code for *🎯DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving*
  ☆108Updated 6 months ago
• StarDewXXX / O1-Pruner
  Official repository for paper: O1-Pruner: Length-Harmonizing Fine-Tuning for O1-Like Reasoning Pruning
  ☆82Updated 4 months ago
• Zanette-Labs / efficient-reasoning
  ☆65Updated 2 months ago
• cmu-l3 / l1
  L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning
  ☆222Updated last month
• GeniusHTX / TALE
  ☆119Updated last month
• MingLiiii / Layer_Gradient
  [ACL'25 Oral] What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective
  ☆65Updated this week
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆88Updated 8 months ago
• liuqidong07 / MOELoRA-peft
  [SIGIR'24] The official implementation code of MOELoRA.
  ☆168Updated 11 months ago
• THU-KEG / AdaptThink
  ☆116Updated 3 weeks ago
• Raibows / CREAM
  Code for "CREAM: Consistency Regularized Self-Rewarding Language Models", ICLR 2025.
  ☆22Updated 4 months ago
• Joshua-Ren / Learning_dynamics_LLM
  ☆139Updated last month
• GAIR-NLP / LIMR
  ☆203Updated 4 months ago
• yczhou001 / Awesome-Diffusion-LLM
  paper list, tutorial, and nano code snippet for Diffusion Large Language Models.
  ☆75Updated this week
• GATECH-EIC / ACT
  [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…
  ☆41Updated 11 months ago
• ZhenweiAn / Dynamic_MoE
  Inference Code for Paper "Harder Tasks Need More Experts: Dynamic Routing in MoE Models"
  ☆52Updated 10 months ago
• MingyuJ666 / Rope_with_LLM
  [ICML'25] Our study systematically investigates massive values in LLMs' attention mechanisms. First, we observe massive values are concen…
  ☆73Updated this week
• sail-sg / sdft
  [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".
  ☆122Updated 7 months ago
• LINs-lab / DynMoE
  [ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models
  ☆110Updated 4 months ago