harveyhuang18 / EMR_Merging
[NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging
☆49Updated last week
Alternatives and similar repositories for EMR_Merging:
Users that are interested in EMR_Merging are comparing it to the libraries listed below
- [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging☆51Updated 3 months ago
- AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.☆67Updated 4 months ago
- Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]☆41Updated 4 months ago
- Code for paper "Parameter Efficient Multi-task Model Fusion with Partial Linearization"☆20Updated 6 months ago
- Codes for Merging Large Language Models☆29Updated 7 months ago
- ☆17Updated 3 months ago
- Representation Surgery for Multi-Task Model Merging. ICML, 2024.☆39Updated 5 months ago
- [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…☆33Updated 8 months ago
- [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)☆50Updated 4 months ago
- Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic☆23Updated 2 months ago
- Code for paper "Merging Multi-Task Models via Weight-Ensembling Mixture of Experts"☆20Updated 9 months ago
- [EMNLP 2023 Main] Sparse Low-rank Adaptation of Pre-trained Language Models☆72Updated last year
- Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient Tuning☆30Updated 3 months ago
- ☆27Updated last year
- Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".☆97Updated last year
- A curated list of Model Merging methods.☆90Updated 5 months ago
- LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning☆28Updated 11 months ago
- Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…☆45Updated 11 months ago
- Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "☆104Updated 4 months ago
- The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"☆36Updated 5 months ago
- DELLA-Merging: Reducing Interference in Model Merging through Magnitude-Based Sampling☆30Updated 8 months ago
- Code accompanying the paper "Massive Activations in Large Language Models"☆148Updated last year
- ☆19Updated 9 months ago
- A block pruning framework for LLMs.☆19Updated 8 months ago
- ☆31Updated last year
- [ICLR 2025] Code&Data for the paper "Super(ficial)-alignment: Strong Models May Deceive Weak Models in Weak-to-Strong Generalization"☆13Updated 8 months ago
- ☆41Updated 4 months ago
- [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.☆69Updated 4 months ago