Clin0212 / HydraLoRA
[NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
☆68Updated this week
Related projects ⓘ
Alternatives and complementary repositories for HydraLoRA
- Awesome-Low-Rank-Adaptation☆33Updated 3 weeks ago
- ☆74Updated 4 months ago
- ☆53Updated 3 months ago
- ICLR 2024, Towards Lossless Dataset Distillation via Difficulty-Aligned Trajectory Matching☆94Updated 5 months ago
- ☆129Updated 2 months ago
- The source code of the EMNLP 2023 main conference paper: Sparse Low-rank Adaptation of Pre-trained Language Models.☆69Updated 8 months ago
- A curated list of Model Merging methods.☆82Updated last month
- [NeurIPS2023] Parameter-efficient Tuning of Large-scale Multimodal Foundation Model☆83Updated 11 months ago
- [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging☆29Updated 3 weeks ago
- The official implementation of "2024NeurIPS Dynamic Tuning Towards Parameter and Inference Efficiency for ViT Adaptation"☆36Updated 3 weeks ago
- Representation Surgery for Multi-Task Model Merging. ICML, 2024.☆27Updated last month
- A generalized framework for subspace tuning methods in parameter efficient fine-tuning.☆99Updated last month
- [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference☆28Updated 5 months ago
- Codes for Merging Large Language Models☆24Updated 3 months ago
- code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"☆14Updated 5 months ago
- MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)☆29Updated 7 months ago
- This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strat…☆71Updated 7 months ago
- [CVPR 2024] On the Diversity and Realism of Distilled Dataset: An Efficient Dataset Distillation Paradigm☆52Updated 6 months ago
- ☆115Updated 3 months ago
- source code of (quasi-)Givens Orthogonal Fine Tuning integrated to peft lib☆13Updated last month
- [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging☆30Updated 3 weeks ago
- [EMNLP 2024 Findings🔥] Official implementation of "LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context Infe…☆76Updated this week
- The official implementation for MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning☆33Updated 3 months ago
- Survey on Data-centric Large Language Models☆64Updated 4 months ago
- (NeurIPS 2023 spotlight) Large-scale Dataset Distillation/Condensation, 50 IPC (Images Per Class) achieves the highest 60.8% on original …☆119Updated this week
- [CVPR2024] Efficient Dataset Distillation via Minimax Diffusion☆78Updated 7 months ago
- ☆146Updated 3 months ago
- Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.☆32Updated last year
- CLIP-MoE: Mixture of Experts for CLIP☆17Updated last month