maidacundo / MoE-LoRALinks
Adapt an LLM model to a Mixture-of-Experts model using Parameter Efficient finetuning (LoRA), injecting the LoRAs in the FFN.
☆70Updated last month
Alternatives and similar repositories for MoE-LoRA
Users that are interested in MoE-LoRA are comparing it to the libraries listed below
Sorting:
- [SIGIR'24] The official implementation code of MOELoRA.☆185Updated last year
- [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".☆138Updated last year
- ☆167Updated last year
- Scaling Preference Data Curation via Human-AI Synergy☆132Updated 5 months ago
- ☆193Updated last year
- ☆122Updated last year
- ☆53Updated 4 months ago
- CPPO: Accelerating the Training of Group Relative Policy Optimization-Based Reasoning Models (NeurIPS 2025)☆168Updated last month
- [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning☆184Updated 5 months ago
- ☆87Updated last year
- ☆171Updated last week
- ☆47Updated 10 months ago
- [EMNLP'25] Code for paper "MT-R1-Zero: Advancing LLM-based Machine Translation via R1-Zero-like Reinforcement Learning"☆61Updated 7 months ago
- [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models☆64Updated last year
- Code and Data for EMNLP 2024 Paper "Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing Agent"☆136Updated 4 months ago
- Inference Code for Paper "Harder Tasks Need More Experts: Dynamic Routing in MoE Models"☆66Updated last year
- xVerify: Efficient Answer Verifier for Reasoning Model Evaluations☆140Updated last month
- OpenRFT: Adapting Reasoning Foundation Model for Domain-specific Tasks with Reinforcement Fine-Tuning☆154Updated 11 months ago
- The code and data of DPA-RAG, accepted by WWW 2025 main conference.☆63Updated last month
- ☆124Updated last year
- ☆52Updated last year
- [ICML2025] The official implementation of "C-3PO: Compact Plug-and-Play Proxy Optimization to Achieve Human-like Retrieval-Augmented Gene…☆40Updated 7 months ago
- ☆112Updated 5 months ago
- Test-time preferenece optimization (ICML 2025).☆172Updated 7 months ago
- ☆39Updated 4 months ago
- [ICML'2024] Can AI Assistants Know What They Don't Know?☆86Updated last year
- The demo, code and data of FollowRAG☆75Updated 5 months ago
- Pre-trained, Scalable, High-performance Reward Models via Policy Discriminative Learning.☆161Updated 2 months ago
- ☆215Updated 2 weeks ago
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆221Updated 4 months ago