maidacundo / MoE-LoRA
Adapt an LLM model to a Mixture-of-Experts model using Parameter Efficient finetuning (LoRA), injecting the LoRAs in the FFN.
☆37Updated 7 months ago
Alternatives and similar repositories for MoE-LoRA
Users that are interested in MoE-LoRA are comparing it to the libraries listed below
Sorting:
- ☆81Updated last year
- [SIGIR'24] The official implementation code of MOELoRA.☆164Updated 9 months ago
- [ICML'2024] Can AI Assistants Know What They Don't Know?☆80Updated last year
- [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios☆66Updated last week
- [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".☆119Updated 6 months ago
- The code and data of DPA-RAG, accepted by WWW 2025 main conference.☆61Updated 3 months ago
- The code of arxiv paper: "CoT-based Synthesizer: Enhancing LLM Performance through Answer Synthesis"☆25Updated last week
- ☆140Updated last year
- Dataset and evaluation script for "Evaluating Hallucinations in Chinese Large Language Models"☆127Updated 11 months ago
- this is an implementation for the paper Improve Mathematical Reasoning in Language Models by Automated Process Supervision from google de…☆30Updated last month
- The demo, code and data of FollowRAG☆72Updated 3 weeks ago
- ☆55Updated 7 months ago
- CORAL: Benchmarking Multi-turn Conversational Retrieval-Augmentation Generation☆51Updated 3 months ago
- Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…☆48Updated 10 months ago
- ☆47Updated 11 months ago
- Clustering and Ranking: Diversity-preserved Instruction Selection through Expert-aligned Quality Estimation☆77Updated 6 months ago
- This the implementation of LeCo☆31Updated 4 months ago
- Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)☆82Updated 3 months ago
- xVerify: Efficient Answer Verifier for Reasoning Model Evaluations☆96Updated last month
- Unofficial implementation of AlpaGasus☆91Updated last year
- ☆134Updated 9 months ago
- [EMNLP 2024] The official GitHub repo for the survey paper "Knowledge Conflicts for LLMs: A Survey"☆119Updated 7 months ago
- [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning☆151Updated 8 months ago
- ☆49Updated last year
- The implement of paper:"ReDeEP: Detecting Hallucination in Retrieval-Augmented Generation via Mechanistic Interpretability"☆22Updated last month
- [ICML 2024] Selecting High-Quality Data for Training Language Models☆171Updated 11 months ago
- code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"☆19Updated 3 months ago
- We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.☆62Updated 6 months ago
- The GitHub repository for the paper "Self-prompted Chain-of-Thought on Large Language Models for Open-domain Multi-hop Reasoning" accepte…☆19Updated last year
- Implementation for the research paper "Enhancing LLM Reasoning via Critique Models with Test-Time and Training-Time Supervision".☆53Updated 5 months ago