Official code for our paper "Model Composition for Multimodal Large Language Models" (ACL 2024)
☆31Jan 8, 2025Updated last year
Alternatives and similar repositories for ModelCompose
Users that are interested in ModelCompose are comparing it to the libraries listed below
Sorting:
- The implementation for FREE-Merging: Fourier Transform for Model Merging with Lightweight Experts (ICCV25)☆14Jun 26, 2025Updated 8 months ago
- Official implementation of "Modeling Multi-Task Model Merging as Adaptive Projective Gradient Descent".☆22May 23, 2025Updated 9 months ago
- ☆12Dec 20, 2024Updated last year
- [NeurIPS 2024] For paper Parameter Competition Balancing for Model Merging☆48Oct 11, 2024Updated last year
- Efficient and Effective Weight-Ensembling Mixture of Experts for Multi-Task Model Merging. Arxiv, 2024.☆16Oct 28, 2024Updated last year
- Official implementation of "OptMerge: Unifying Multimodal LLM Capabilities and Modalities via Model Merging".☆45Oct 30, 2025Updated 4 months ago
- Code for paper "LLMs Can Evolve Continually on Modality for X-Modal Reasoning" NeurIPS2024☆41Dec 18, 2024Updated last year
- [ICML 2024] Model Tailor: Mitigating Catastrophic Forgetting in Multi-modal Large Language Models☆34Sep 1, 2024Updated last year
- [ICML 2023] "Robust Weight Signatures: Gaining Robustness as Easy as Patching Weights?" by Ruisi Cai, Zhenyu Zhang, Zhangyang Wang☆16May 4, 2023Updated 2 years ago
- Repo for paper "MUSEG: Reinforcing Video Temporal Understanding via Timestamp-Aware Multi-Segment Grounding".☆39Jun 9, 2025Updated 9 months ago
- CVPR 2022 (Oral) Pytorch Code for Unsupervised Vision-and-Language Pre-training via Retrieval-based Multi-Granular Alignment☆22Apr 15, 2022Updated 3 years ago
- Unofficial Visual Prompt Tuning implementation☆17May 22, 2023Updated 2 years ago
- ☆33Jul 8, 2024Updated last year
- Official codebase of "Update Your Transformer to the Latest Release: Re-Basin of Task Vectors" - ICML 2025☆23Jul 30, 2025Updated 7 months ago
- MAP: Low-compute Model Merging with Amortized Pareto Fronts via Quadratic Approximation☆14Sep 2, 2024Updated last year
- Codes for Merging Large Language Models☆35Aug 7, 2024Updated last year
- [MM 2025] Towards Modality Generalization: A Benchmark and Prospective Analysis☆28May 22, 2025Updated 9 months ago
- [AAAI 2026] Relation-R1: Progressively Cognitive Chain-of-Thought Guided Reinforcement Learning for Unified Relation Comprehension☆18Mar 6, 2026Updated 2 weeks ago
- Official code for paper "Shadow-FT: Tuning Instruct via Base"☆42Sep 29, 2025Updated 5 months ago
- Official Repository for CLRCMD (Appear in ACL2022)☆43Feb 21, 2023Updated 3 years ago
- DSADCSR FOR AIM2019 Extreme Super-Resolution Challenge - Track 1: Fidelity☆13May 27, 2020Updated 5 years ago
- ☆211Feb 3, 2024Updated 2 years ago
- Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. ACM Computing Surveys, 2026.☆689Updated this week
- Task Singular Vectors: Reducing Task Interference in Model Merging. Merge models avoiding task interference through separable models.☆51Dec 15, 2025Updated 3 months ago
- RadGraph: Extracting Clinical Entities and Relations from Radiology Reports☆13Nov 22, 2022Updated 3 years ago
- [ICML 2025] No Task Left Behind: Isotropic Model Merging with Common and Task-Specific Subspaces (official repository)☆40Aug 7, 2025Updated 7 months ago
- CVPR 2024 (Highlight)☆144Oct 20, 2024Updated last year
- The official implementation for Collaborative Word-based Pre-trained Item Representation for Transferable Recommendation.☆25Jan 30, 2024Updated 2 years ago
- IPO: Interpretable Prompt Optimization for Vision-Language Models(NeurIPS 2024)☆15Mar 4, 2025Updated last year
- ☆10Jun 2, 2022Updated 3 years ago
- Multimodal Federated Learning on IoT Data☆11Dec 17, 2023Updated 2 years ago
- ☆13May 21, 2024Updated last year
- Self-Knowledge Guided Retrieval Augmentation for Large Language Models (EMNLP Findings 2023)☆28Dec 8, 2023Updated 2 years ago
- Secure and Scalable Federated Learning using Serverless Computing☆12Jan 31, 2024Updated 2 years ago
- Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]☆52Dec 22, 2025Updated 2 months ago
- Self-Teaching Notes on Gradient Leakage Attacks against GPT-2 models.☆14Mar 18, 2024Updated 2 years ago
- [CVPR 2025] LoRA Recycle: Unlocking Tuning-Free Few-Shot Adaptability in Visual Foundation Models by Recycling Pre-Tuned LoRAs☆13Jun 20, 2025Updated 9 months ago
- Official code for DAM: Dynamic Adapter Merging for Continual Video QA Learning☆14Apr 25, 2024Updated last year
- ☆11Aug 20, 2025Updated 7 months ago