Adapt an LLM model to a Mixture-of-Experts model using Parameter Efficient finetuning (LoRA), injecting the LoRAs in the FFN.
☆94Oct 21, 2025Updated last year
Alternatives and similar repositories for MoE-LoRA
Users that are interested in MoE-LoRA are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [SIGIR'24] The official implementation code of MOELoRA.☆196Jul 22, 2024Updated 2 years ago
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆403Apr 29, 2024Updated 2 years ago
- State-of-the-art Parameter-Efficient MoE Fine-tuning Method☆211Aug 22, 2024Updated 2 years ago
- An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT☆145Mar 11, 2025Updated last year
- This is the office repository for ACL 2024 paper "Learning or Self-aligning? Rethinking Instruction Fine-tuning"☆11Aug 11, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- The collections of MOE (Mixture Of Expert) papers, code and tools, etc.☆12Mar 15, 2024Updated 2 years ago
- The official implementation of ICCV 25 OP-SAM "One Polyp Identifies All: One-Shot Polyp Segmentation with SAM via Cascaded Priors and Ite…☆15Jul 9, 2025Updated last year
- ☆15Jun 16, 2023Updated 3 years ago
- ☆11May 13, 2026Updated 6 months ago
- ☆74Dec 2, 2024Updated last year
- [ICML 2026] AdaMEM: Test-Time Adaptive Memory for Language Agents☆15Jun 22, 2026Updated 5 months ago
- [EMNLP 2024 Findings] Unlocking Continual Learning Abilities in Language Models☆25Oct 8, 2024Updated 2 years ago
- ☆11Feb 14, 2025Updated last year
- ☆11Jul 10, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- AdaMoLE: Adaptive Mixture of LoRA Experts☆38Oct 11, 2024Updated 2 years ago
- Implementation for MTL-LoRA: Low-Rank Adaptation for Multi-Task Learning☆24Apr 1, 2025Updated last year
- Continual Memorization of Factoids in Large Language Models☆12Nov 20, 2024Updated 2 years ago
- Code for [Re] On the Reproducibility of Post-Hoc Concept Bottleneck Models.☆13Nov 27, 2024Updated last year
- Code repo for " fMRI-LM: Towards a Universal Foundation Model for Language-Aligned fMRI Understanding"☆12Sep 18, 2026Updated 2 months ago
- [NeurIPS 2025]: CPO: Condition Preference Optimization for Controllable Image Generation☆13Dec 13, 2025Updated 11 months ago
- ☆11Jun 16, 2026Updated 5 months ago
- Deepfake cross-lingual evaluation dataset (DECRO) is constructed to evaluate the influence of language differences on deepfake detection.…☆16Sep 14, 2023Updated 3 years ago
- Multimodal Instruction Tuning with Conditional Mixture of LoRA (ACL 2024)☆34Aug 9, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- EAG-RS: A Novel Explainability-guided ROI Selection Framework for ASD diagnosis via Inter-regional Relation Learning - PyTorch Implementa…☆10Dec 20, 2023Updated 2 years ago
- ☆16Mar 14, 2026Updated 8 months ago
- [ACM Computing Survey 2025] Recent Advances of Foundation Language Models-based Continual Learning: A Survey☆27Oct 6, 2025Updated last year
- ☆14Apr 16, 2026Updated 7 months ago
- Built on the robust XTuner backend framework, XTuner Chat GUI offers a user-friendly platform for quick and efficient local model inferen…☆13Feb 5, 2024Updated 2 years ago
- (TCSVT 2024) Official PyTorch implementation of paper "Continual Action Assessment via Task-Consistent Score-Discriminative Feature Distr…☆13Mar 19, 2025Updated last year
- Code release for RICA^2: Rubric-Informed, Calibrated Assessment of Actions (ECCV 2024)☆16Nov 9, 2025Updated last year
- ☆16Jun 25, 2025Updated last year
- This is the official repository for the code and datasets in the paper "Progressive Open Space Expansion for Open-Set Model Attribution",…☆23Oct 22, 2023Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- This repository contains code for the paper "Layer by Layer: Uncovering Where Multi-Task Learning Happens in Instruction-Tuned Large Lang…☆10Nov 12, 2024Updated 2 years ago
- This is the repo of our Memory Driven Proactive Agent☆16Oct 22, 2026Updated last month
- RTGMFF: Enhanced fMRI-based Brain Disorder Diagnosis via ROI-driven Text Generation and Multimodal Feature Fusion☆13Aug 3, 2025Updated last year
- ☆279Oct 31, 2023Updated 3 years ago
- This repository contains the code and resources for our ACL 2024 Findings paper, "Deciphering Digital Detectives: Understanding LLM Behav…☆10Dec 9, 2025Updated 11 months ago
- The code of TAI'25 paper GLAC-GCN☆10Sep 29, 2026Updated last month
- [MICCAI'26] Official Pytorch Code for Spectral-Temporal State Space Modeling on Functional Brain Networks☆17May 11, 2026Updated 6 months ago
Are these results useful?