david3684 / AdaRank
Official codebase for AdaRank: Adaptive Rank Pruning for Enhanced Model Merging
☆14Updated this week
Alternatives and similar repositories for AdaRank
Users that are interested in AdaRank are comparing it to the libraries listed below
Sorting:
- Task Singular Vectors: Reducing Task Interference in Model Merging. Merge models avoiding task interference through separable models.☆13Updated 2 weeks ago
- Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]☆44Updated 6 months ago
- AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.☆80Updated 6 months ago
- ☆28Updated 2 months ago
- [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging☆58Updated 2 months ago
- Benchmark for Natural Temporal Distribution Shift (NeurIPS 2022)☆66Updated 2 years ago
- Code for "Can We Scale Transformers to Predict Parameters of Diverse ImageNet Models?" [ICML 2023]☆32Updated 8 months ago
- ☆13Updated 2 years ago
- [ICML 2024] Probabilistic Conceptual Explainers (PACE): Trustworthy Conceptual Explanations for Vision Foundation Models☆14Updated last month
- Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".☆101Updated last year
- ☆24Updated 2 months ago
- Code for paper "Parameter Efficient Multi-task Model Fusion with Partial Linearization"☆21Updated 8 months ago
- ☆18Updated last month
- Representation Surgery for Multi-Task Model Merging. ICML, 2024.☆45Updated 7 months ago
- Deep Learning & Information Bottleneck☆60Updated last year
- Official source code for "Graph Neural Networks for Learning Equivariant Representations of Neural Networks". In ICLR 2024 (oral).☆80Updated 9 months ago
- ☆30Updated 10 months ago
- source code of (quasi-)Givens Orthogonal Fine Tuning integrated to peft lib☆16Updated 2 months ago
- Official code implementation of "GEX: A flexible method for approximating influence via Geometric Ensemble" (NeurIPS 2023)☆13Updated last year
- [NeurIPS 2023 Spotlight] Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training☆34Updated last month
- source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"☆25Updated 10 months ago
- ☆39Updated 2 years ago
- Bayesian Low-Rank Adaptation for Large Language Models☆33Updated 10 months ago
- [EMNLP 2023, Main Conference] Sparse Low-rank Adaptation of Pre-trained Language Models☆76Updated last year
- Official PyTorch implementation for NeurIPS'24 paper "Knowledge Composition using Task Vectors with Learned Anisotropic Scaling"☆19Updated 2 months ago
- Official implementation of ORCA proposed in the paper "Cross-Modal Fine-Tuning: Align then Refine"☆71Updated last year
- ☆9Updated 2 years ago
- Official implementation for Equivariant Architectures for Learning in Deep Weight Spaces [ICML 2023]☆89Updated last year
- [ICLR2023] NTK-SAP: Improving neural network pruning by aligning training dynamics☆18Updated 2 years ago
- Code for "Surgical Fine-Tuning Improves Adaptation to Distribution Shifts" published at ICLR 2023☆28Updated last year