adamxyang / laplace-lora
Bayesian low-rank adaptation for large language models
☆23Updated 6 months ago
Related projects ⓘ
Alternatives and complementary repositories for laplace-lora
- Bayesian Low-Rank Adaptation for Large Language Models☆27Updated 4 months ago
- ☆25Updated 9 months ago
- Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".☆84Updated last year
- Model zoo for different kinds of uncertainty quantification methods used in Natural Language Processing, implemented in PyTorch.☆47Updated last year
- Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic☆16Updated 2 months ago
- ☆44Updated 10 months ago
- Code for "Surgical Fine-Tuning Improves Adaptation to Distribution Shifts" published at ICLR 2023☆28Updated last year
- Lightweight Adapting for Black-Box Large Language Models☆18Updated 8 months ago
- Implementation of Gradient Information Optimization (GIO) for effective and scalable training data selection☆11Updated last year
- ☆61Updated 2 years ago
- Test-time-training on nearest neighbors for large language models☆25Updated 6 months ago
- Benchmark for Natural Temporal Distribution Shift (NeurIPS 2022)☆61Updated last year
- This is the repository for "Model Merging by Uncertainty-Based Gradient Matching", ICLR 2024.☆20Updated 5 months ago
- DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models (ICLR 2024)☆51Updated last month
- Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]☆34Updated 2 weeks ago
- ☆25Updated 4 months ago
- Code for the paper "Mehta, S. V., Patil, D., Chandar, S., & Strubell, E. (2023). An Empirical Investigation of the Role of Pre-training i…☆16Updated 7 months ago
- Code for NeurIPS'23 paper "A Bayesian Approach To Analysing Training Data Attribution In Deep Learning"☆13Updated 9 months ago
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆51Updated this week
- ☆35Updated 9 months ago
- ☆75Updated 4 months ago
- Conformal Language Modeling☆22Updated 10 months ago
- ☆14Updated 8 months ago
- [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors☆69Updated 8 months ago
- ☆31Updated last year
- Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]☆14Updated 6 months ago
- AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.☆49Updated last week
- ☆13Updated 6 months ago
- `dattri` is a PyTorch library for developing, benchmarking, and deploying efficient data attribution algorithms.☆30Updated last week
- AI Logging for Interpretability and Explainability🔬☆87Updated 5 months ago