EnnengYang / AdaMerging
AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
☆62Updated 3 months ago
Alternatives and similar repositories for AdaMerging:
Users that are interested in AdaMerging are comparing it to the libraries listed below
- [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging☆43Updated 3 months ago
- Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]☆39Updated 3 months ago
- [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging☆48Updated last month
- Code for paper "Merging Multi-Task Models via Weight-Ensembling Mixture of Experts"☆18Updated 7 months ago
- Representation Surgery for Multi-Task Model Merging. ICML, 2024.☆34Updated 3 months ago
- Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".☆92Updated last year
- Code for paper "Parameter Efficient Multi-task Model Fusion with Partial Linearization"☆17Updated 4 months ago
- Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic☆22Updated 2 weeks ago
- A curated list of Model Merging methods.☆89Updated 4 months ago
- [ACL 2024] Code and data for "Machine Unlearning of Pre-trained Large Language Models"☆53Updated 4 months ago
- Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient Tuning☆29Updated 2 months ago
- ☆31Updated last year
- ☆48Updated last year
- Official Repository for The Paper: Safety Alignment Should Be Made More Than Just a Few Tokens Deep☆65Updated 6 months ago
- ☆160Updated 11 months ago
- [NeurIPS 2024] "Can Language Models Perform Robust Reasoning in Chain-of-thought Prompting with Noisy Rationales?"☆30Updated 2 weeks ago
- Official Code for Paper: Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications☆68Updated 3 months ago
- ☆62Updated 2 years ago
- ☆36Updated 2 months ago
- [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors☆72Updated last month
- ☆45Updated 6 months ago
- A block pruning framework for LLMs.☆15Updated 7 months ago
- [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning☆88Updated 8 months ago
- [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View☆46Updated 3 months ago
- source code for NeurIPS'24 paper "HaloScope: Harnessing Unlabeled LLM Generations for Hallucination Detection"☆30Updated last month
- TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models☆63Updated last year
- Official repo for EMNLP'24 paper "SOUL: Unlocking the Power of Second-Order Optimization for LLM Unlearning"☆17Updated 3 months ago
- Landing Page for TOFU☆107Updated last month
- This is the official code for the paper "Vaccine: Perturbation-aware Alignment for Large Language Models" (NeurIPS2024)☆33Updated 2 months ago
- DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models (ICLR 2024)☆61Updated 3 months ago