Applied-Machine-Learning-Lab / MOELoRA-peftLinks
[SIGIR'24] The official implementation code of MOELoRA.
☆36Updated last year
Alternatives and similar repositories for MOELoRA-peft
Users that are interested in MOELoRA-peft are comparing it to the libraries listed below
Sorting:
- [SIGIR'24] The official implementation code of MOELoRA.☆186Updated last year
- ☆175Updated last year
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆394Updated last year
- [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning☆233Updated last year
- ☆57Updated 7 months ago
- An implementation of SEAL: Safety-Enhanced Aligned LLM fine-tuning via bilevel data selection.☆22Updated 11 months ago
- ☆196Updated last year
- Code for ACL 2024 accepted paper titled "SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language …☆38Updated last year
- ☆182Updated last week
- ☆28Updated last year
- This repository collects awesome survey, resource, and paper for Lifelong Learning for Large Language Models. (Updated Regularly)☆70Updated 8 months ago
- The latest progress of Personalized Large Language Models (LLMs).☆33Updated 3 weeks ago
- MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)☆45Updated 7 months ago
- code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"☆33Updated 11 months ago
- ☆152Updated last year
- ☆10Updated last year
- ☆125Updated last year
- State-of-the-art Parameter-Efficient MoE Fine-tuning Method☆203Updated last year
- [ICLR 2026] Learning to Parallel: Accelerating Diffusion Large Language Models via Learnable Parallel Decoding☆28Updated this week
- ☆13Updated 10 months ago
- Awesome Low-Rank Adaptation☆59Updated 5 months ago
- 大模型进阶面经☆96Updated 8 months ago
- Inference Code for Paper "Harder Tasks Need More Experts: Dynamic Routing in MoE Models"☆67Updated last year
- A generalized framework for subspace tuning methods in parameter efficient fine-tuning.☆168Updated 7 months ago
- AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).☆365Updated 2 years ago
- ☆305Updated 6 months ago
- [ICLR 2025] Code and Data Repo for Paper "Latent Space Chain-of-Embedding Enables Output-free LLM Self-Evaluation"☆93Updated last year
- [NeurIPS 2024] The implementation of paper "On Softmax Direct Preference Optimization for Recommendation"☆96Updated last year
- AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.☆100Updated last year
- SePer is an accurate / fast / free-of-API metric to measure document quality via information gain☆29Updated 4 months ago