Adapt an LLM model to a Mixture-of-Experts model using Parameter Efficient finetuning (LoRA), injecting the LoRAs in the FFN.
☆83Oct 21, 2025Updated 5 months ago
Alternatives and similar repositories for MoE-LoRA
Users that are interested in MoE-LoRA are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [SIGIR'24] The official implementation code of MOELoRA.☆192Jul 22, 2024Updated last year
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆403Apr 29, 2024Updated last year
- ☆177Jul 22, 2024Updated last year
- State-of-the-art Parameter-Efficient MoE Fine-tuning Method☆203Aug 22, 2024Updated last year
- The source code of "A Novel Image Tamper Detection and Self-recovery Algorithm Based on Watermarking and Chaotic System"☆11Apr 22, 2021Updated 4 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Code for [Re] On the Reproducibility of Post-Hoc Concept Bottleneck Models.☆13Nov 27, 2024Updated last year
- [ACM Computing Survey 2025] Recent Advances of Foundation Language Models-based Continual Learning: A Survey☆26Oct 6, 2025Updated 6 months ago
- 🐍📦 Ultra-fast Python package for calculating and analyzing the Word Error Rate (WER). Built for the scalable evaluation of speech and t…☆25Mar 30, 2026Updated 2 weeks ago
- ☆69Dec 2, 2024Updated last year
- Mixture of Lora Experts☆10Apr 7, 2024Updated 2 years ago
- ☆17Jul 22, 2024Updated last year
- ☆17May 5, 2024Updated last year
- The second generation of VoiceFixer, a toolkit for general speech restoration. *Not affiliated with the original VoiceFixer repo*☆21Nov 19, 2023Updated 2 years ago
- ☆276Oct 31, 2023Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- AdaMoLE: Adaptive Mixture of LoRA Experts☆38Oct 11, 2024Updated last year
- Official code repository for "CLARE: Continual Learning for Vision-Language-Action Models via Autonomous Adapter Routing and Expansion".☆35Apr 11, 2026Updated last week
- Hand Mesh Recovery models on OakInk-Image dataset☆13Apr 4, 2024Updated 2 years ago
- [EMNLP 2024 Findings] Unlocking Continual Learning Abilities in Language Models☆26Oct 8, 2024Updated last year
- Official implementation of Our NeurIPS 2024 Paper "Boundary Matters: A Bi-Level Active Finetuning Method"☆14Feb 11, 2025Updated last year
- ☆14Jun 16, 2023Updated 2 years ago
- ☆48Mar 8, 2026Updated last month
- ☆16Mar 20, 2026Updated 3 weeks ago
- This repository has transferred to https://github.com/TUDB-Labs/MoE-PEFT☆22Aug 16, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆28Mar 10, 2026Updated last month
- ☆10Dec 15, 2023Updated 2 years ago
- Token-level adaptation of LoRA matrices for downstream task generalization.☆15Apr 14, 2024Updated 2 years ago
- ☆37Nov 15, 2025Updated 5 months ago
- 大模型训练、推理、推荐系统相关☆30Nov 30, 2025Updated 4 months ago
- Code for the paper Alpha Zero in Continuous Action Space (A0C) (https://arxiv.org/pdf/1805.09613.pdf)☆15Jan 19, 2021Updated 5 years ago
- Learning MLPs to replace GNN☆10Jun 3, 2023Updated 2 years ago
- ☆10Mar 4, 2024Updated 2 years ago
- Improving large language models with concept-aware fine-tuning (CAFT)☆29Jan 31, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- arxiv翻译修复器！☆22Nov 13, 2024Updated last year
- ☆17Apr 11, 2025Updated last year
- This repository documents Barry's journey in learning deep learning for speech processing. Here, you'll find scripts and code snippets re…☆13Oct 8, 2025Updated 6 months ago
- Converting VIS json label to VOS format☆12Feb 16, 2021Updated 5 years ago
- Reasoning or Memorization? Unreliable Results of Reinforcement Learning Due to Data Contamination.☆22Jul 18, 2025Updated 9 months ago
- ☆25Aug 29, 2025Updated 7 months ago
- Semi-supervised optical flow network☆26Feb 21, 2023Updated 3 years ago