ArthurLeoM / peft-givensLinks
source code of (quasi-)Givens Orthogonal Fine Tuning integrated to peft lib
☆17Updated 10 months ago
Alternatives and similar repositories for peft-givens
Users that are interested in peft-givens are comparing it to the libraries listed below
Sorting:
- ☆152Updated last year
- LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning☆36Updated last year
- CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for task-aware parameter-efficient fine-tuning(NeurIPS 2024)☆53Updated last year
- [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning☆234Updated last year
- Awesome-Low-Rank-Adaptation☆126Updated last year
- [EMNLP 2023, Main Conference] Sparse Low-rank Adaptation of Pre-trained Language Models☆84Updated last year
- [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging☆74Updated 10 months ago
- Official Pytorch Implementation of "Outlier-weighed Layerwise Sampling for LLM Fine-tuning" by Pengxiang Li, Lu Yin, Xiaowei Gao, Shiwei …☆35Updated 7 months ago
- ☆28Updated last year
- A generalized framework for subspace tuning methods in parameter efficient fine-tuning.☆164Updated 6 months ago
- AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.☆98Updated last year
- A curated list of Model Merging methods.☆95Updated last month
- Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]☆51Updated 3 weeks ago
- Code for paper "Parameter Efficient Multi-task Model Fusion with Partial Linearization"☆24Updated last year
- Awesome Low-Rank Adaptation☆59Updated 5 months ago
- ☆62Updated last year
- ☆11Updated 5 months ago
- ☆125Updated last year
- Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "☆142Updated 9 months ago
- Data distillation benchmark☆71Updated 7 months ago
- The official implementation of "2024NeurIPS Dynamic Tuning Towards Parameter and Inference Efficiency for ViT Adaptation"☆52Updated last year
- ICLR 2024, Towards Lossless Dataset Distillation via Difficulty-Aligned Trajectory Matching☆105Updated last year
- ☆36Updated 4 months ago
- [ICLR 2025] "Noisy Test-Time Adaptation in Vision-Language Models"☆17Updated 10 months ago
- ☆31Updated 3 weeks ago
- ☆216Updated last month
- LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters☆45Updated 5 months ago
- [CVPR2024 highlight] Generalized Large-Scale Data Condensation via Various Backbone and Statistical Matching (G-VBSM)☆28Updated last year
- CKA (Centered Kernel Alignment) implemented in PyTorch☆52Updated 3 weeks ago
- ☆30Updated 2 years ago