Code for paper "Merging Multi-Task Models via Weight-Ensembling Mixture of Experts"
☆35Jun 7, 2024Updated 2 years ago
Alternatives and similar repositories for weight-ensembling_MoE
Users that are interested in weight-ensembling_MoE are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Efficient and Effective Weight-Ensembling Mixture of Experts for Multi-Task Model Merging. Arxiv, 2024.☆16Oct 28, 2024Updated 2 years ago
- Official implementation of "Modeling Multi-Task Model Merging as Adaptive Projective Gradient Descent".☆23May 23, 2025Updated last year
- official code repo for paper "Merging Models on the Fly Without Retraining: A Sequential Approach to Scalable Continual Model Merging"☆25Oct 11, 2025Updated last year
- AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.☆116Oct 28, 2024Updated 2 years ago
- Code for paper "Parameter Efficient Multi-task Model Fusion with Partial Linearization"☆26Sep 13, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- The code repository for "MINGLE: Mixture of Null-Space Gated Low-Rank Experts for Test-Time Continual Model Merging"(NeurIPS25) in PyTorc…☆16Jun 2, 2026Updated 4 months ago
- FusionBench: A Comprehensive Benchmark/Toolkit of Deep Model Fusion☆244Updated this week
- Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]☆53Dec 22, 2025Updated 10 months ago
- Codes for Merging Large Language Models☆37Aug 7, 2024Updated 2 years ago
- Continual Model Merging without Data: Dual Projections for Balancing Stability and Plasticity. NeurIPS, 2025.☆13Oct 12, 2025Updated last year
- ☆18Aug 19, 2024Updated 2 years ago
- [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging☆143Mar 17, 2025Updated last year
- Official repository for Activation-Informed Merging (AIM) of Large Language Models☆25Feb 10, 2025Updated last year
- Code for paper "Towards Efficient Pareto Set Approximation via Weight-Ensembling Mixture of Experts"☆11Jul 30, 2026Updated 3 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- SyMerge: From Non-Interference to Synergistic Merging via Single-Layer Adaptation☆12Jul 6, 2026Updated 3 months ago
- Representation Surgery for Multi-Task Model Merging. ICML, 2024.☆51Oct 10, 2024Updated 2 years ago
- A curated list of Model Merging methods.☆95Dec 3, 2025Updated 10 months ago
- ☆30Sep 16, 2026Updated last month
- [ICML 2026] Hybrid Policy Distillation (HPD) is a practical distillation framework for reasoning-oriented language models. This repositor …☆24Apr 24, 2026Updated 6 months ago
- a FiRst And Naive r1-liKe multimodal LLMs☆12Apr 25, 2025Updated last year
- ☆19Sep 15, 2026Updated last month
- ☆15May 4, 2024Updated 2 years ago
- [NeurIPS 2025] MergeBench: A Benchmark for Merging Domain-Specialized LLMs☆54Aug 28, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [ICML 2025] No Task Left Behind: Isotropic Model Merging with Common and Task-Specific Subspaces (official repository)☆47Aug 7, 2025Updated last year
- ☆83Mar 17, 2022Updated 4 years ago
- Prism: A Plug-in Reproducible Infrastructure for Scalable Multimodal Continual Instruction Tuning☆52Oct 20, 2026Updated last week
- Model merging is a highly efficient approach for long-to-short reasoning.☆104Oct 15, 2025Updated last year
- Task Singular Vectors: Reducing Task Interference in Model Merging. Merge models avoiding task interference through separable models.☆59Dec 15, 2025Updated 10 months ago
- [ICLR 2025] Official implementation of "Mitigating Parameter Interference in Model Merging via Sharpness-Aware Fine-Tuning"☆11Apr 21, 2025Updated last year
- Multimodal Large Language Model (MLLM) Tuning Survey: Keeping Yourself is Important in Downstream Tuning Multimodal Large Language Model☆102Oct 19, 2026Updated last week
- Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".☆114Jun 8, 2023Updated 3 years ago
- [ICML 2024] Code release for "On the Emergence of Cross-Task Linearity in Pretraining-Finetuning Paradigm"☆11Feb 20, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Official Code Repo for Paper: Posterior Refinement☆14Sep 22, 2026Updated last month
- ☆15Sep 29, 2026Updated last month
- Official code for our paper "Model Composition for Multimodal Large Language Models" (ACL 2024)☆31Jan 8, 2025Updated last year
- [NeurIPS 24] MoE Jetpack: From Dense Checkpoints to Adaptive Mixture of Experts for Vision Tasks☆139Nov 23, 2024Updated last year
- Official implementation of the paper "Linear Model Merging Unlocks Simple and Scalable Multimodal Data Mixture Optimization".☆14Feb 16, 2026Updated 8 months ago
- Code release for Normalizing Flow Maps☆17Oct 19, 2026Updated last week
- 🔥 🔥 [ECCV 2024 Oral ] Official code for "Weighted Ensemble Models Are Strong Continual Learners"☆30Apr 16, 2025Updated last year