cmnfriend / O-LoRALinks
☆186Updated last year
Alternatives and similar repositories for O-LoRA
Users that are interested in O-LoRA are comparing it to the libraries listed below
Sorting:
- ☆159Updated last year
- Code for ACL 2024 accepted paper titled "SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language …☆36Updated 8 months ago
- ☆210Updated 11 months ago
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆377Updated last year
- AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).☆352Updated 2 years ago
- [SIGIR'24] The official implementation code of MOELoRA.☆182Updated last year
- ☆117Updated last year
- TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models☆79Updated last year
- [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".☆132Updated 11 months ago
- A generalized framework for subspace tuning methods in parameter efficient fine-tuning.☆154Updated 3 months ago
- [ICLR 2025] Released code for paper "Spurious Forgetting in Continual Learning of Language Models"☆52Updated 5 months ago
- [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning☆222Updated 10 months ago
- This repository collects awesome survey, resource, and paper for Lifelong Learning for Large Language Models. (Updated Regularly)☆65Updated 4 months ago
- ☆54Updated 10 months ago
- MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)☆44Updated 3 months ago
- Repository for Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning☆165Updated last year
- Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "☆132Updated 6 months ago
- [EMNLP 2023, Main Conference] Sparse Low-rank Adaptation of Pre-trained Language Models☆83Updated last year
- State-of-the-art Parameter-Efficient MoE Fine-tuning Method☆189Updated last year
- Must-read Papers of Parameter-Efficient Tuning (Delta Tuning) Methods on Pre-trained Models.☆285Updated 2 years ago
- Model merging is a highly efficient approach for long-to-short reasoning.☆84Updated 4 months ago
- code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"☆32Updated 7 months ago
- Must-read Papers on Large Language Model (LLM) Continual Learning☆145Updated last year
- [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning☆497Updated 11 months ago
- An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT☆120Updated 7 months ago
- [EMNLP 2025] TokenSkip: Controllable Chain-of-Thought Compression in LLMs☆182Updated 3 months ago
- PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models(NeurIPS 2024 Spotlight)☆385Updated 3 months ago
- AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.☆90Updated 11 months ago
- Paper List for In-context Learning 🌷☆185Updated last year
- [CSUR 2025] Continual Learning of Large Language Models: A Comprehensive Survey☆458Updated 4 months ago