maidacundo / MoE-LoRAView external linksLinks
Adapt an LLM model to a Mixture-of-Experts model using Parameter Efficient finetuning (LoRA), injecting the LoRAs in the FFN.
☆84Oct 21, 2025Updated 3 months ago
Alternatives and similar repositories for MoE-LoRA
Users that are interested in MoE-LoRA are comparing it to the libraries listed below
Sorting:
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆400Apr 29, 2024Updated last year
- ☆176Jul 22, 2024Updated last year
- An implementation of Distortion-Free Wide-Angle Portraits on Camera Phones☆10Dec 24, 2019Updated 6 years ago
- State-of-the-art Parameter-Efficient MoE Fine-tuning Method☆203Aug 22, 2024Updated last year
- ☆11Feb 14, 2025Updated 11 months ago
- [ACM Computing Survey 2025] Recent Advances of Foundation Language Models-based Continual Learning: A Survey☆24Oct 6, 2025Updated 4 months ago
- Code repository of "GenieDrive: Towards Physics-Aware Driving World Model with 4D Occupancy Guided Video Generation"☆58Dec 17, 2025Updated last month
- [EMNLP 2024 Findings] Unlocking Continual Learning Abilities in Language Models☆26Oct 8, 2024Updated last year
- Implementation of Mimic-Video, Video-Action Models for SOTA Generalizable Robot Control Beyond VLAs☆84Feb 5, 2026Updated last week
- This repository has transferred to https://github.com/TUDB-Labs/MoE-PEFT☆22Aug 16, 2024Updated last year
- Forked from https://github.com/rwightman/pytorch-image-models☆22Jan 11, 2024Updated 2 years ago
- Official implementation for "Sparse Concept Bottleneck Models: Gumbel Tricks in Contrastive Learning"☆12Jun 20, 2025Updated 7 months ago
- Frequency Autoregressive Image Generation with Continuous Tokens☆94Jun 9, 2025Updated 8 months ago
- ☆34Aug 2, 2023Updated 2 years ago
- ☆36Sep 23, 2022Updated 3 years ago
- Diffusers pipeline for inpainting with any available finetune☆35Jul 8, 2023Updated 2 years ago
- AdaMoLE: Adaptive Mixture of LoRA Experts☆38Oct 11, 2024Updated last year
- Distributed AlexNet with tensorflow☆10Aug 14, 2018Updated 7 years ago
- Code Roberta version of RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder☆10Mar 16, 2023Updated 2 years ago
- ☆11Oct 25, 2024Updated last year
- Codes for the paper "Single-Image Reflection Removal via a Two-Stage Background Recovery Process"☆11Sep 24, 2021Updated 4 years ago
- ☆10Apr 30, 2025Updated 9 months ago
- Software library RLCM (recursively low-rank compressed matrices)☆14Apr 15, 2021Updated 4 years ago
- ☆23Jan 21, 2026Updated 3 weeks ago
- Russian phonetical transcription☆11Nov 19, 2025Updated 2 months ago
- A trading algorithm utilizing a Naive Bayes classifier to predict expected returns, GARCH (1,1) volatility forecasting, and the Markowitz…☆10Dec 22, 2017Updated 8 years ago
- ☆52Jun 24, 2025Updated 7 months ago
- paper list, tutorial, and nano code snippet for Diffusion Large Language Models.☆154Jan 19, 2026Updated 3 weeks ago
- 条件随机场(CRF)的pytorch实现☆10Mar 7, 2021Updated 4 years ago
- Repo - Paper "Capturing Semantics for Imputation with Pre-trained Language Models." [ICDE 2021]☆10Mar 13, 2022Updated 3 years ago