mrflogs / LoRA-Pro
Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "
☆108Updated 3 weeks ago
Alternatives and similar repositories for LoRA-Pro:
Users that are interested in LoRA-Pro are comparing it to the libraries listed below
- ☆99Updated 8 months ago
- A generalized framework for subspace tuning methods in parameter efficient fine-tuning.☆132Updated last month
- ☆186Updated 5 months ago
- ☆170Updated 8 months ago
- [EMNLP 2023 Main] Sparse Low-rank Adaptation of Pre-trained Language Models☆72Updated last year
- [MM2024, oral] "Self-Supervised Visual Preference Alignment" https://arxiv.org/abs/2404.10501☆55Updated 8 months ago
- Awesome-Low-Rank-Adaptation☆87Updated 5 months ago
- ☆131Updated 8 months ago
- Dataset pruning for ImageNet and LAION-2B.☆76Updated 8 months ago
- Official Pytorch Implementation of "OwLore: Outlier-weighed Layerwise Sampled Low-Rank Projection for Memory-Efficient LLM Fine-tuning" b…☆31Updated 10 months ago
- ☆17Updated 4 months ago
- [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging☆53Updated last month
- ☆35Updated 8 months ago
- Codes for Merging Large Language Models☆29Updated 7 months ago
- [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment☆57Updated 6 months ago
- Code release for VTW (AAAI 2025) Oral☆33Updated 2 months ago
- The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"☆37Updated 5 months ago
- [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning☆181Updated 4 months ago
- MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)☆34Updated 11 months ago
- ☆23Updated 9 months ago
- LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning☆29Updated 11 months ago
- code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"☆19Updated last month
- Code for "ECoFLaP: Efficient Coarse-to-Fine Layer-Wise Pruning for Vision-Language Models" (ICLR 2024)☆19Updated last year
- CoT-Valve: Length-Compressible Chain-of-Thought Tuning☆56Updated last month
- AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.☆72Updated 5 months ago
- CLIP-MoE: Mixture of Experts for CLIP☆29Updated 5 months ago
- This repo contains the source code for VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks (NeurIPS 2024).☆37Updated 5 months ago
- This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strat…☆77Updated last month
- ☆48Updated 3 months ago
- A block pruning framework for LLMs.☆21Updated 9 months ago