ArthurLeoM / peft-givens
source code of (quasi-)Givens Orthogonal Fine Tuning integrated to peft lib
☆14Updated 5 months ago
Alternatives and similar repositories for peft-givens:
Users that are interested in peft-givens are comparing it to the libraries listed below
- [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging☆49Updated last week
- Code for paper "Parameter Efficient Multi-task Model Fusion with Partial Linearization"☆20Updated 6 months ago
- Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]☆41Updated 4 months ago
- Awesome-Low-Rank-Adaptation☆83Updated 5 months ago
- [EMNLP 2023 Main] Sparse Low-rank Adaptation of Pre-trained Language Models☆72Updated last year
- Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic☆23Updated 2 months ago
- The official implementation of "2024NeurIPS Dynamic Tuning Towards Parameter and Inference Efficiency for ViT Adaptation"☆41Updated 2 months ago
- Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "☆104Updated 4 months ago
- Instruction Tuning in Continual Learning paradigm☆42Updated last month
- ☆47Updated 2 months ago
- CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for task-aware parameter-efficient fine-tuning(NeurIPS 2024)☆42Updated 2 months ago
- Official code for ICLR 2024 paper, "A Hard-to-Beat Baseline for Training-free CLIP-based Adaptation"☆76Updated 10 months ago
- [NeurIPS 2024] For paper Parameter Competition Balancing for Model Merging☆36Updated 5 months ago
- ☆97Updated 8 months ago
- [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning☆170Updated 3 months ago
- AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.☆67Updated 4 months ago
- ☆23Updated 9 months ago
- LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters☆30Updated last week
- ☆19Updated 9 months ago
- Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…☆45Updated 11 months ago
- Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)☆14Updated 7 months ago
- The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"☆36Updated 5 months ago
- [NeurIPS 2023] "Diversified Outlier Exposure for Out-of-Distribution Detection via Informative Extrapolation"☆11Updated last year
- ☆14Updated 6 months ago
- Representation Surgery for Multi-Task Model Merging. ICML, 2024.☆39Updated 5 months ago
- ☆142Updated 6 months ago
- LCA-on-the-line (ICML 2024 Oral)☆11Updated last month
- This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strat…☆75Updated 2 weeks ago
- Data distillation benchmark☆57Updated 3 weeks ago
- A curated list of Model Merging methods.☆90Updated 5 months ago