pilancilab / Riemannian_Preconditioned_LoRALinks
source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"
☆26Updated 11 months ago
Alternatives and similar repositories for Riemannian_Preconditioned_LoRA
Users that are interested in Riemannian_Preconditioned_LoRA are comparing it to the libraries listed below
Sorting:
- Deep Learning & Information Bottleneck☆60Updated last year
- Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)☆14Updated 10 months ago
- SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)☆31Updated 7 months ago
- Source code of "What can linearized neural networks actually say about generalization?☆20Updated 3 years ago
- A modern look at the relationship between sharpness and generalization [ICML 2023]☆43Updated last year
- ☆34Updated last year
- Code for the paper "The Journey, Not the Destination: How Data Guides Diffusion Models"☆22Updated last year
- Visualization of mean field and neural tangent kernel regime☆20Updated 10 months ago
- Code for the paper "Efficient Dataset Distillation using Random Feature Approximation"☆37Updated 2 years ago
- [NeurIPS 2024] BLoB: Bayesian Low-Rank Adaptation by Backpropagation for Large Language Models☆27Updated 4 months ago
- Bayesian Low-Rank Adaptation for Large Language Models☆34Updated 11 months ago
- ☆28Updated 3 months ago
- Official implementation for Equivariant Architectures for Learning in Deep Weight Spaces [ICML 2023]☆89Updated last year
- [ICLR2023] NTK-SAP: Improving neural network pruning by aligning training dynamics☆18Updated 2 years ago
- ☆28Updated this week
- ☆67Updated 5 months ago
- Repo for the paper: "Agree to Disagree: Diversity through Disagreement for Better Transferability"☆36Updated 2 years ago
- ☆19Updated 2 months ago
- ☆30Updated 10 months ago
- ☆32Updated last year
- ☆27Updated 2 years ago
- This is the official implementation of the ICML 2023 paper - Can Forward Gradient Match Backpropagation ?☆12Updated 2 years ago
- ☆18Updated 2 years ago
- ☆35Updated 2 years ago
- Recycling diverse models☆44Updated 2 years ago
- ☆22Updated 3 years ago
- Discover and Cure: Concept-aware Mitigation of Spurious Correlation (ICML 2023)☆41Updated last year
- This is the project for IRM methods☆12Updated 3 years ago
- ☆19Updated 10 months ago
- ☆45Updated 2 years ago