maidacundo / MoE-LoRALinks
Adapt an LLM model to a Mixture-of-Experts model using Parameter Efficient finetuning (LoRA), injecting the LoRAs in the FFN.
☆67Updated last month
Alternatives and similar repositories for MoE-LoRA
Users that are interested in MoE-LoRA are comparing it to the libraries listed below
Sorting:
- [SIGIR'24] The official implementation code of MOELoRA.☆184Updated last year
- [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".☆136Updated last year
- ☆168Updated last year
- ☆119Updated last year
- Inference Code for Paper "Harder Tasks Need More Experts: Dynamic Routing in MoE Models"☆66Updated last year
- ☆86Updated last year
- ☆190Updated last year
- Official code implementation for the ACL 2025 paper: 'CoT-based Synthesizer: Enhancing LLM Performance through Answer Synthesis'☆31Updated 6 months ago
- Code and Data for EMNLP 2024 Paper "Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing Agent"☆136Updated 4 months ago
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆385Updated last year
- ☆123Updated last year
- CPPO: Accelerating the Training of Group Relative Policy Optimization-Based Reasoning Models (NeurIPS 2025)☆167Updated 2 weeks ago
- ☆165Updated last month
- [EMNLP'25] Code for paper "MT-R1-Zero: Advancing LLM-based Machine Translation via R1-Zero-like Reinforcement Learning"☆61Updated 7 months ago
- [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning☆182Updated 4 months ago
- Scaling Preference Data Curation via Human-AI Synergy☆128Updated 4 months ago
- Test-time preferenece optimization (ICML 2025).☆169Updated 6 months ago
- Official completion of “Training on the Benchmark Is Not All You Need”.☆37Updated 10 months ago
- [ACL 2025] An official pytorch implement of the paper: Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement☆37Updated 5 months ago
- [ICLR'25] DataGen: Unified Synthetic Dataset Generation via Large Language Models☆64Updated 8 months ago
- The demo, code and data of FollowRAG☆75Updated 4 months ago
- Fantastic Data Engineering for Large Language Models☆92Updated 10 months ago
- code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"☆33Updated 9 months ago
- ☆52Updated last year
- [MM 2025] CMM-Math: A Chinese Multimodal Math Dataset To Evaluate and Enhance the Mathematics Reasoning of Large Multimodal Models☆47Updated last year
- [ICML'2024] Can AI Assistants Know What They Don't Know?☆83Updated last year
- The code and data of DPA-RAG, accepted by WWW 2025 main conference.☆63Updated last month
- RewardAnything: Generalizable Principle-Following Reward Models☆44Updated 5 months ago
- [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models☆63Updated 11 months ago
- ☆213Updated last year