maidacundo / MoE-LoRALinks
Adapt an LLM model to a Mixture-of-Experts model using Parameter Efficient finetuning (LoRA), injecting the LoRAs in the FFN.
☆63Updated last week
Alternatives and similar repositories for MoE-LoRA
Users that are interested in MoE-LoRA are comparing it to the libraries listed below
Sorting:
- [SIGIR'24] The official implementation code of MOELoRA.☆184Updated last year
- ☆161Updated last year
- [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".☆135Updated last year
- ☆84Updated last year
- [EMNLP'25] Code for paper "MT-R1-Zero: Advancing LLM-based Machine Translation via R1-Zero-like Reinforcement Learning"☆60Updated 6 months ago
- ☆118Updated last year
- Scaling Preference Data Curation via Human-AI Synergy☆122Updated 4 months ago
- Official code implementation for the ACL 2025 paper: 'CoT-based Synthesizer: Enhancing LLM Performance through Answer Synthesis'☆31Updated 5 months ago
- The code and data of DPA-RAG, accepted by WWW 2025 main conference.☆63Updated last week
- ☆157Updated 3 weeks ago
- ☆25Updated last year
- ☆50Updated 3 months ago
- ☆187Updated last year
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆381Updated last year
- CPPO: Accelerating the Training of Group Relative Policy Optimization-Based Reasoning Models (NeurIPS 2025)☆156Updated 2 weeks ago
- this is an implementation for the paper Improve Mathematical Reasoning in Language Models by Automated Process Supervision from google de…☆42Updated 3 months ago
- xVerify: Efficient Answer Verifier for Reasoning Model Evaluations☆136Updated 6 months ago
- ☆96Updated 2 years ago
- The demo, code and data of FollowRAG☆75Updated 4 months ago
- ☆123Updated last year
- 中文大语言模型评测第三期☆32Updated 2 months ago
- [ACL 2025] We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLM…☆68Updated last year
- [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning☆180Updated 4 months ago
- Fantastic Data Engineering for Large Language Models☆91Updated 10 months ago
- [ACL 2025] An official pytorch implement of the paper: Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement☆37Updated 5 months ago
- Inference Code for Paper "Harder Tasks Need More Experts: Dynamic Routing in MoE Models"☆64Updated last year
- ☆23Updated 6 months ago
- Test-time preferenece optimization (ICML 2025).☆168Updated 5 months ago
- (ICLR'25) A Comprehensive Framework for Developing and Evaluating Multimodal Role-Playing Agents☆87Updated 9 months ago
- ☆108Updated 4 months ago