Alternatives and similar repositories for MoE-LoRA

Users that are interested in MoE-LoRA are comparing it to the libraries listed below

• liuqidong07 / MOELoRA-peft
  [SIGIR'24] The official implementation code of MOELoRA.
  ☆176Updated last year
• GCYZSL / MoLA
  ☆151Updated last year
• sail-sg / sdft
  [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".
  ☆128Updated 9 months ago
• pldlgb / nuggets
  ☆83Updated last year
• SkyworkAI / Skywork-Reward-V2
  Scaling Preference Data Curation via Human-AI Synergy
  ☆100Updated last month
• TemporaryLoRA / Temp-LoRA
  ☆109Updated last year
• cmnfriend / O-LoRA
  ☆184Updated last year
• sanowl / OmegaPRM
  this is an implementation for the paper Improve Mathematical Reasoning in Language Models by Automated Process Supervision from google de…
  ☆37Updated last month
• tianyi-lab / Superfiltering
  [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning
  ☆170Updated 2 months ago
• Ablustrund / LoRAMoE
  LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment
  ☆370Updated last year
• multimodal-art-projection / COIG-P
  ☆38Updated last month
• InternLM / Condor
  [ACL 2025] An official pytorch implement of the paper: Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement
  ☆34Updated 3 months ago
• dongguanting / DPA-RAG
  The code and data of DPA-RAG, accepted by WWW 2025 main conference.
  ☆61Updated 7 months ago
• THU-KEG / AdaptThink
  ☆147Updated 3 months ago
• pengr / DataMan
  Our code for ICLR'25 paper "DataMan: Data Manager for Pre-training Large Language Models".
  ☆102Updated last week
• IAAR-Shanghai / xVerify
  xVerify: Efficient Answer Verifier for Reasoning Model Evaluations
  ☆128Updated 4 months ago
• tianyi-lab / Cherry_LLM
  [NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other mo…
  ☆385Updated 2 months ago
• RUCKBReasoning / CoT-based-Synthesizer
  Official code implementation for the ACL 2025 paper: 'CoT-based Synthesizer: Enhancing LLM Performance through Answer Synthesis'
  ☆26Updated 3 months ago
• Mryangkaitong / deepseek-r1-gsm8k
  ☆47Updated 6 months ago
• ZhenweiAn / Dynamic_MoE
  Inference Code for Paper "Harder Tasks Need More Experts: Dynamic Routing in MoE Models"
  ☆60Updated last year
• yangjianxin1 / LongQLoRA
  LongQLoRA: Extent Context Length of LLMs Efficiently
  ☆166Updated last year
• yuleiqin / fantastic-data-engineering
  Fantastic Data Engineering for Large Language Models
  ☆90Updated 8 months ago
• lzhxmu / CPPO
  CPPO: Accelerating the Training of Group Relative Policy Optimization-Based Reasoning Models
  ☆149Updated 2 months ago
• OpenMOSS / Say-I-Dont-Know
  [ICML'2024] Can AI Assistants Know What They Don't Know?
  ☆83Updated last year
• dongguanting / FollowRAG
  The demo, code and data of FollowRAG
  ☆74Updated 2 months ago
• weiyifan1023 / Neeko
  Code and Data for EMNLP 2024 Paper "Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing Agent"
  ☆131Updated last month
• FlagOpen / Infinity-Instruct
  ☆50Updated last year
• InternLM / POLAR
  Pre-trained, Scalable, High-performance Reward Models via Policy Discriminative Learning.
  ☆150Updated last month
• CASIA-LM / MoDS
  ☆145Updated last year
• ChasonShi / MELoRA
  code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"
  ☆32Updated 6 months ago