pilancilab / Riemannian_Preconditioned_LoRA
source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"
☆23Updated 9 months ago
Alternatives and similar repositories for Riemannian_Preconditioned_LoRA:
Users that are interested in Riemannian_Preconditioned_LoRA are comparing it to the libraries listed below
- Deep Learning & Information Bottleneck☆58Updated last year
- Source code of "What can linearized neural networks actually say about generalization?☆20Updated 3 years ago
- Bayesian Low-Rank Adaptation for Large Language Models☆29Updated 9 months ago
- ☆29Updated last year
- SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)☆30Updated 4 months ago
- Code for the paper "The Journey, Not the Destination: How Data Guides Diffusion Models"☆22Updated last year
- Visualization of mean field and neural tangent kernel regime☆21Updated 8 months ago
- ☆65Updated 3 months ago
- ☆18Updated 4 months ago
- A modern look at the relationship between sharpness and generalization [ICML 2023]☆43Updated last year
- [NeurIPS 2024] BLoB: Bayesian Low-Rank Adaptation by Backpropagation for Large Language Models☆24Updated last month
- ☆18Updated 8 months ago
- PyTorch implementation of the paper "Discovering and Explaining the Representation Bottleneck of DNNs" (ICLR 2022)☆38Updated 4 months ago
- Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)☆14Updated 8 months ago
- Towards Understanding Sharpness-Aware Minimization [ICML 2022]☆35Updated 2 years ago
- Benchmark for Natural Temporal Distribution Shift (NeurIPS 2022)☆65Updated last year
- Code for "SAM as an Optimal Relaxation of Bayes", ICLR 2023.☆25Updated last year
- Welcome to the 'In Context Learning Theory' Reading Group☆28Updated 4 months ago
- [NeurIPS 2023] Code release for "Going Beyond Linear Mode Connectivity: The Layerwise Linear Feature Connectivity"☆17Updated last year
- Pytorch code for experiments on Linear Transformers☆20Updated last year
- Official implementation for Equivariant Architectures for Learning in Deep Weight Spaces [ICML 2023]☆86Updated last year
- ☆34Updated last year
- ☆44Updated 2 years ago
- Repository for the NeurIPS 2023 paper "Beyond Confidence: Reliable Models Should Also Consider Atypicality"☆12Updated 11 months ago
- Implementations of orthogonal and semi-orthogonal convolutions in the Fourier domain with applications to adversarial robustness☆44Updated 3 years ago
- This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…☆35Updated 2 years ago
- ☆13Updated 2 years ago
- Efficient empirical NTKs in PyTorch☆18Updated 2 years ago
- ☆16Updated 2 years ago
- Implementation of PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆35Updated 4 months ago