MaximeRobeyns / bayesian_loraLinks
Bayesian Low-Rank Adaptation for Large Language Models
☆36Updated last year
Alternatives and similar repositories for bayesian_lora
Users that are interested in bayesian_lora are comparing it to the libraries listed below
Sorting:
- Bayesian low-rank adaptation for large language models☆28Updated last year
- Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".☆110Updated 2 years ago
- ☆241Updated last year
- Framework code with wandb, checkpointing, logging, configs, experimental protocols. Useful for fine-tuning models or training from scratc…☆154Updated 3 years ago
- This is the repository for "Model Merging by Uncertainty-Based Gradient Matching", ICLR 2024.☆29Updated last year
- Benchmark for Natural Temporal Distribution Shift (NeurIPS 2022)☆68Updated 2 years ago
- ☆32Updated last year
- Deep Learning & Information Bottleneck☆63Updated 2 years ago
- ☆80Updated 3 years ago
- source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"☆33Updated last year
- ☆73Updated last year
- Code for "Surgical Fine-Tuning Improves Adaptation to Distribution Shifts" published at ICLR 2023☆29Updated 2 years ago
- Code and results accompanying our paper titled RLSbench: Domain Adaptation under Relaxed Label Shift☆35Updated 2 years ago
- A curated list of Model Merging methods.☆96Updated 2 months ago
- Code for "Just Train Twice: Improving Group Robustness without Training Group Information"☆73Updated last year
- A simple PyTorch implementation of influence functions.☆92Updated last year
- Repo for the paper: "Agree to Disagree: Diversity through Disagreement for Better Transferability"☆36Updated 3 years ago
- This is an official repository for "LAVA: Data Valuation without Pre-Specified Learning Algorithms" (ICLR2023).☆52Updated last year
- SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)☆39Updated last year
- Towards Understanding Sharpness-Aware Minimization [ICML 2022]☆38Updated 3 years ago
- Official implementation of ORCA proposed in the paper "Cross-Modal Fine-Tuning: Align then Refine"☆73Updated last year
- ☆111Updated 2 years ago
- ☆63Updated 4 years ago
- Code for the paper "Efficient Dataset Distillation using Random Feature Approximation"☆37Updated 2 years ago
- Bayesian Low-Rank Adaptation of LLMs: BLoB [NeurIPS 2024] and TFB [NeurIPS 2025]☆33Updated 4 months ago
- ☆34Updated 2 years ago
- Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)☆13Updated last year
- A modern look at the relationship between sharpness and generalization [ICML 2023]☆43Updated 2 years ago
- [NeurIPS 2021] A Geometric Analysis of Neural Collapse with Unconstrained Features☆60Updated 3 years ago
- ☆22Updated 4 years ago