yushuiwx / Mixture-of-LoRA-ExpertsLinks
☆50Updated 8 months ago
Alternatives and similar repositories for Mixture-of-LoRA-Experts
Users that are interested in Mixture-of-LoRA-Experts are comparing it to the libraries listed below
Sorting:
- ☆151Updated last year
- [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning☆220Updated 8 months ago
- ☆184Updated last year
- [ICLR 2025] Released code for paper "Spurious Forgetting in Continual Learning of Language Models"☆50Updated 3 months ago
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆370Updated last year
- State-of-the-art Parameter-Efficient MoE Fine-tuning Method☆180Updated last year
- ☆207Updated 10 months ago
- ☆34Updated 10 months ago
- Code for ACL 2024 accepted paper titled "SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language …☆35Updated 7 months ago
- MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)☆43Updated 2 months ago
- An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT☆111Updated 5 months ago
- ☆49Updated last month
- 😎 curated list of awesome LMM hallucinations papers, methods & resources.☆149Updated last year
- TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models☆79Updated last year
- [SIGIR'24] The official implementation code of MOELoRA.☆176Updated last year
- The reinforcement learning codes for dataset SPA-VL☆36Updated last year
- This repository contains a regularly updated paper list for LLMs-reasoning-in-latent-space.☆153Updated last week
- Repository for Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning☆163Updated last year
- ☆163Updated 3 months ago
- 😎 A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, Agent, and Beyond☆286Updated 2 weeks ago
- The repo for In-context Autoencoder☆135Updated last year
- TokenSkip: Controllable Chain-of-Thought Compression in LLMs☆174Updated 2 months ago
- [NeurIPS 2023] Github repository for "Composing Parameter-Efficient Modules with Arithmetic Operations"☆61Updated last year
- ☆261Updated last month
- AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).☆344Updated 2 years ago
- Model merging is a highly efficient approach for long-to-short reasoning.☆80Updated 2 months ago
- Awesome Low-Rank Adaptation☆43Updated 3 weeks ago
- [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.☆79Updated 9 months ago
- Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. arXiv:2408.07666.☆510Updated this week
- The trainer for HF to record losses of different tasks and objectives.☆44Updated 5 months ago