Alternatives and similar repositories for transformer-fusion

Users that are interested in transformer-fusion are comparing it to the libraries listed below

• nik-dim / tall_masks
  Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]
  ☆51Updated last year
• tanganke / peta
  Code for paper "Parameter Efficient Multi-task Model Fusion with Partial Linearization"
  ☆24Updated last year
• pilancilab / Riemannian_Preconditioned_LoRA
  source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"
  ☆33Updated last year
• harveyhuang18 / EMR_Merging
  [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging
  ☆72Updated 9 months ago
• EnnengYang / RepresentationSurgery
  Representation Surgery for Multi-Task Model Merging. ICML, 2024.
  ☆47Updated last year
• TsinghuaC3I / SoRA
  [EMNLP 2023, Main Conference] Sparse Low-rank Adaptation of Pre-trained Language Models
  ☆85Updated last year
• tanganke / opcm
  official code repo for paper "Merging Models on the Fly Without Retraining: A Sequential Approach to Scalable Continual Model Merging"
  ☆22Updated 2 months ago
• PKU-ML / non_neg
  Official Code for ICLR 2024 Paper: Non-negative Contrastive Learning
  ☆46Updated last year
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆97Updated last year
• Chaos96 / fourierft
  ☆151Updated last year
• AntoAndGar / task_singular_vectors
  Task Singular Vectors: Reducing Task Interference in Model Merging. Merge models avoiding task interference through separable models.
  ☆38Updated 4 months ago
• DaShenZi721 / HRA
  ☆31Updated 2 weeks ago
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆94Updated last week
• hqsiswiliam / hira
  The repo for HiRA paper
  ☆35Updated 4 months ago
• uiuctml / Localize-and-Stitch
  Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic
  ☆31Updated 2 months ago
• Wuyxin / DISC
  (ICML 2023) Discover and Cure: Concept-aware Mitigation of Spurious Correlation
  ☆42Updated 3 weeks ago
• Pbihao / SLM
  ☆28Updated last year
• UKPLab / iclr2024-model-merging
  This is the repository for "Model Merging by Uncertainty-Based Gradient Matching", ICLR 2024.
  ☆29Updated last year
• ExplainableML / sae-for-vlm
  [NeurIPS 2025] Sparse Autoencoders Learn Monosemantic Features in Vision-Language Models
  ☆49Updated 2 weeks ago
• gortizji / tangent_task_arithmetic
  Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".
  ☆107Updated 2 years ago
• adymaharana / d2pruning
  ☆43Updated 2 years ago
• yikangshen / MoA
  Mixture of Attention Heads
  ☆51Updated 3 years ago
• mmatena / model_merging
  ☆79Updated 3 years ago
• QingyangZhang / EMPO
  [NeurIPS25 Spotlight] EMPO, A Fully Unsupervised RLVR Method
  ☆87Updated 3 weeks ago
• yule-BUAA / MergeLLM
  Codes for Merging Large Language Models
  ☆34Updated last year
• Clin0212 / HydraLoRA
  [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
  ☆235Updated last year
• PKU-ML / ContraNorm
  Official code for ICLR 2023 paper "ContraNorm: A Contrastive Learning Perspective on Oversmoothing and Beyond "
  ☆35Updated 2 years ago
• xu-ji / information-bottleneck
  Deep Learning & Information Bottleneck
  ☆62Updated 2 years ago
• IBM / model-reprogramming
  Repository for research works and resources related to model reprogramming <https://arxiv.org/abs/2202.10629>
  ☆64Updated 2 months ago
• ShiZhengyan / DePT
  [ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"
  ☆99Updated last year