A framework for merging models solving different tasks with different initializations into one multi-task model without any additional training
☆312Jan 18, 2024Updated 2 years ago
Alternatives and similar repositories for ZipIt
Users that are interested in ZipIt are comparing it to the libraries listed below
Sorting:
- ☆211Feb 3, 2024Updated 2 years ago
- A curated list of Model Merging methods.☆95Dec 3, 2025Updated 3 months ago
- Git Re-Basin: Merging Models modulo Permutation Symmetries in PyTorch☆78Feb 9, 2023Updated 3 years ago
- Code for "Merging Text Transformers from Different Initializations"☆20Feb 2, 2025Updated last year
- Code release for REPAIR: REnormalizing Permuted Activations for Interpolation Repair☆52Jan 29, 2024Updated 2 years ago
- Code release for "Git Re-Basin: Merging Models modulo Permutation Symmetries"☆507Mar 7, 2023Updated 3 years ago
- Official PyTorch Implementation of "Learning to Learn with Generative Models of Neural Network Checkpoints"☆345Oct 3, 2022Updated 3 years ago
- This repository is the implementation of the paper Training Free Pretrained Model Merging (CVPR2024).☆33Mar 5, 2024Updated 2 years ago
- Codes for the paper "Optimizing Mode Connectivity via Neuron Alignment" from NeurIPS 2020.☆16Dec 10, 2020Updated 5 years ago
- Codebase for Merging Language Models (ICML 2024)☆863May 5, 2024Updated last year
- Editing Models with Task Arithmetic☆535Jan 11, 2024Updated 2 years ago
- Model Merging with SVD to Tie the KnOTS [ICLR 2025]☆86Apr 3, 2025Updated 11 months ago
- Model Fusion via Optimal Transport, NeurIPS 2020☆155Nov 16, 2022Updated 3 years ago
- This repo contains code for the paper: "Can Foundation Models Help Us Achieve Perfect Secrecy?"☆24Feb 9, 2023Updated 3 years ago
- Replicating and dissecting the git-re-basin project in one-click-replication Colabs☆37Sep 19, 2022Updated 3 years ago
- [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition☆669Jul 22, 2024Updated last year
- Code for CVPR 2024 Oral "Neural Lineage"☆17Jun 18, 2024Updated last year
- Tools for merging pretrained large language models.☆6,842Feb 28, 2026Updated last week
- [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging☆77Mar 1, 2025Updated last year
- ☆77Apr 29, 2024Updated last year
- an official PyTorch implementation of the paper "Partial Network Cloning", CVPR 2023☆13Mar 21, 2023Updated 2 years ago
- Implementation of Hyena Hierarchy in JAX☆10Apr 30, 2023Updated 2 years ago
- PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"☆37Oct 11, 2023Updated 2 years ago
- [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging☆140Mar 17, 2025Updated 11 months ago
- Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)☆92Jul 25, 2023Updated 2 years ago
- The implementation for FREE-Merging: Fourier Transform for Model Merging with Lightweight Experts (ICCV25)☆14Jun 26, 2025Updated 8 months ago
- Code to reproduce the experiments of the ICLR24-paper: "Sparse Model Soups: A Recipe for Improved Pruning via Model Averaging"☆12Oct 14, 2025Updated 4 months ago
- Code for ACL 2023 Oral Paper: ManagerTower: Aggregating the Insights of Uni-Modal Experts for Vision-Language Representation Learning☆12Aug 23, 2025Updated 6 months ago
- [ECCV2022] Factorizing Knowledge in Neural Networks☆91Sep 12, 2022Updated 3 years ago
- ☆23Nov 1, 2022Updated 3 years ago
- Codes for Merging Large Language Models☆35Aug 7, 2024Updated last year
- Package to align tokens from different tokenizations.☆16Mar 25, 2024Updated last year
- NeurIPS 2025 Spotlight; ICLR2024 Spotlight; CVPR 2024; EMNLP 2024☆1,821Nov 27, 2025Updated 3 months ago
- Official repository of Evolutionary Optimization of Model Merging Recipes☆1,403Nov 29, 2024Updated last year
- Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates☆473Apr 21, 2024Updated last year
- Official code for the paper "Examining Post-Training Quantization for Mixture-of-Experts: A Benchmark"☆30Jun 30, 2025Updated 8 months ago
- Apply methods described in "Git Re-basin"-paper [1] to arbitrary models --- [1] Ainsworth et al. (https://arxiv.org/abs/2209.04836)☆15Mar 2, 2026Updated last week
- [NeurIPS 2023] This repository includes the official implementation of our paper "An Inverse Scaling Law for CLIP Training"☆319Jun 3, 2024Updated last year
- FusionBench: A Comprehensive Benchmark/Toolkit of Deep Model Fusion☆205Mar 1, 2026Updated last week