Alternatives and similar repositories for transformer-fusion:

Users that are interested in transformer-fusion are comparing it to the libraries listed below

• tanganke / peta
  Code for paper "Parameter Efficient Multi-task Model Fusion with Partial Linearization"
  ☆20Updated 6 months ago
• uiuctml / Localize-and-Stitch
  Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic
  ☆23Updated 2 months ago
• nik-dim / tall_masks
  Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]
  ☆41Updated 4 months ago
• EnnengYang / RepresentationSurgery
  Representation Surgery for Multi-Task Model Merging. ICML, 2024.
  ☆39Updated 5 months ago
• TsinghuaC3I / SoRA
  [EMNLP 2023 Main] Sparse Low-rank Adaptation of Pre-trained Language Models
  ☆72Updated last year
• harveyhuang18 / EMR_Merging
  [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging
  ☆49Updated last week
• LZY-the-boys / Twin-Merging
  [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging
  ☆51Updated 3 months ago
• gortizji / tangent_task_arithmetic
  Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".
  ☆97Updated last year
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆67Updated 4 months ago
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆90Updated 5 months ago
• ArthurLeoM / peft-givens
  source code of (quasi-)Givens Orthogonal Fine Tuning integrated to peft lib
  ☆14Updated 5 months ago
• hkust-nlp / PEM_composition
  [NeurIPS 2023] Github repository for "Composing Parameter-Efficient Modules with Arithmetic Operations"
  ☆60Updated last year
• JingXuTHU / Random-Masking-Finds-Winning-Tickets-for-Parameter-Efficient-Fine-tuning
  ☆13Updated 10 months ago
• UKPLab / iclr2024-model-merging
  This is the repository for "Model Merging by Uncertainty-Based Gradient Matching", ICLR 2024.
  ☆27Updated 9 months ago
• MohammadrezaBanaei / LoRA-XS
  LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters
  ☆30Updated last week
• OPTML-Group / WAGLE
  Official repo for NeurIPS'24 paper "WAGLE: Strategic Weight Attribution for Effective and Modular Unlearning in Large Language Models"
  ☆12Updated 2 months ago
• NUS-HPC-AI-Lab / DD-Ranking
  Data distillation benchmark
  ☆57Updated 3 weeks ago
• mmatena / model_merging
  ☆65Updated 2 years ago
• mpagli / Agree-to-Disagree
  Repo for the paper: "Agree to Disagree: Diversity through Disagreement for Better Transferability"
  ☆35Updated 2 years ago
• git-disl / Lisa
  This is the official code for the paper "Lazy Safety Alignment for Large Language Models against Harmful Fine-tuning" (NeurIPS2024)
  ☆17Updated 6 months ago
• tmlr-group / NoisyRationales
  [NeurIPS 2024] "Can Language Models Perform Robust Reasoning in Chain-of-thought Prompting with Noisy Rationales?"
  ☆34Updated last month
• cjyaras / deep-lora-transformers
  Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)
  ☆14Updated 7 months ago
• arumaekawa / DiLM
  Implementaiton of "DiLM: Distilling Dataset into Language Model for Text-level Dataset Distillation" (accepted by NAACL2024 Findings)".
  ☆17Updated last month
• Wuyxin / DISC
  Discover and Cure: Concept-aware Mitigation of Spurious Correlation (ICML 2023)
  ☆41Updated 11 months ago
• IBM / model-reprogramming
  Repository for research works and resources related to model reprogramming <https://arxiv.org/abs/2202.10629>
  ☆60Updated 11 months ago
• DavidFanzz / SCMoE
  ☆19Updated 9 months ago
• Wang-ML-Lab / bayesian-peft
  [NeurIPS 2024] BLoB: Bayesian Low-Rank Adaptation by Backpropagation for Large Language Models
  ☆24Updated last month