Clin0212 / HydraLoRALinks
[NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
☆220Updated 8 months ago
Alternatives and similar repositories for HydraLoRA
Users that are interested in HydraLoRA are comparing it to the libraries listed below
Sorting:
- A generalized framework for subspace tuning methods in parameter efficient fine-tuning.☆153Updated last month
- Awesome-Low-Rank-Adaptation☆115Updated 9 months ago
- ☆148Updated last year
- ☆111Updated last year
- ☆204Updated 9 months ago
- State-of-the-art Parameter-Efficient MoE Fine-tuning Method☆175Updated 11 months ago
- ☆147Updated 10 months ago
- Paper List of Inference/Test Time Scaling/Computing☆286Updated last month
- ☆183Updated last year
- One-shot Entropy Minimization☆172Updated last month
- [arXiv 2025] Efficient Reasoning Models: A Survey☆244Updated 2 weeks ago
- [EMNLP 2023, Main Conference] Sparse Low-rank Adaptation of Pre-trained Language Models☆80Updated last year
- [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging☆62Updated 5 months ago
- AlphaEdit: Null-Space Constrained Knowledge Editing for Language Models, ICLR 2025 (Outstanding Paper)☆291Updated 3 weeks ago
- An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT☆108Updated 4 months ago
- [ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models☆121Updated 3 weeks ago
- CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for task-aware parameter-efficient fine-tuning(NeurIPS 2024)☆48Updated 6 months ago
- ☆153Updated 2 months ago
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆360Updated last year
- ☆46Updated 8 months ago
- Survey on Data-centric Large Language Models☆85Updated last year
- AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.☆88Updated 9 months ago
- Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "☆127Updated 3 months ago
- Code release for VTW (AAAI 2025 Oral)☆46Updated 2 weeks ago
- [EMNLP 2024 Findings🔥] Official implementation of ": LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context In…☆97Updated 8 months ago
- AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).☆338Updated 2 years ago
- Awesome Low-Rank Adaptation☆40Updated 2 weeks ago
- 🚀 LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training☆86Updated 8 months ago
- A Collection of Papers on Diffusion Language Models☆97Updated last month
- PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models(NeurIPS 2024 Spotlight)☆367Updated last month