gortizji / tangent_task_arithmetic
Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".
☆99Updated last year
Alternatives and similar repositories for tangent_task_arithmetic:
Users that are interested in tangent_task_arithmetic are comparing it to the libraries listed below
- Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]☆41Updated 5 months ago
- ☆66Updated 3 years ago
- ☆50Updated last year
- Code for paper "Parameter Efficient Multi-task Model Fusion with Partial Linearization"☆20Updated 7 months ago
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆71Updated last month
- [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging☆55Updated last month
- ☆22Updated last month
- ☆29Updated 9 months ago
- AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.☆74Updated 5 months ago
- Function Vectors in Large Language Models (ICLR 2024)☆156Updated 3 weeks ago
- This is the repository for "Model Merging by Uncertainty-Based Gradient Matching", ICLR 2024.☆27Updated 10 months ago
- DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models (ICLR 2024)☆63Updated 6 months ago
- ☆93Updated last year
- Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic☆23Updated 3 months ago
- Git Re-Basin: Merging Models modulo Permutation Symmetries in PyTorch☆75Updated 2 years ago
- ☆172Updated last year
- official code for paper Probing the Decision Boundaries of In-context Learning in Large Language Models. https://arxiv.org/abs/2406.11233…☆17Updated 7 months ago
- AI Logging for Interpretability and Explainability🔬☆111Updated 10 months ago
- ☆91Updated 2 months ago
- Code accompanying the paper "Massive Activations in Large Language Models"☆154Updated last year
- PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆35Updated 5 months ago
- ☆31Updated 3 months ago
- Bayesian Low-Rank Adaptation for Large Language Models☆30Updated 9 months ago
- [NeurIPS 2023 Spotlight] Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training☆34Updated this week
- ☆10Updated 2 months ago
- A curated list of Model Merging methods.☆91Updated 6 months ago
- Preprint: Asymmetry in Low-Rank Adapters of Foundation Models☆35Updated last year
- Bayesian low-rank adaptation for large language models☆23Updated 11 months ago
- ☆54Updated 2 years ago
- Representation Surgery for Multi-Task Model Merging. ICML, 2024.☆43Updated 6 months ago