Alternatives and similar repositories for transformer-fusion

Users that are interested in transformer-fusion are comparing it to the libraries listed below

• nik-dim / tall_masks
  Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]
  ☆45Updated 8 months ago
• harveyhuang18 / EMR_Merging
  [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging
  ☆59Updated 3 months ago
• tanganke / peta
  Code for paper "Parameter Efficient Multi-task Model Fusion with Partial Linearization"
  ☆21Updated 9 months ago
• AntoAndGar / task_singular_vectors
  Task Singular Vectors: Reducing Task Interference in Model Merging. Merge models avoiding task interference through separable models.
  ☆16Updated last month
• PKU-ML / non_neg
  Official Code for ICLR 2024 Paper: Non-negative Contrastive Learning
  ☆45Updated last year
• DaShenZi721 / HRA
  ☆29Updated 3 weeks ago
• uiuctml / Localize-and-Stitch
  Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic
  ☆26Updated 5 months ago
• UKPLab / iclr2024-model-merging
  This is the repository for "Model Merging by Uncertainty-Based Gradient Matching", ICLR 2024.
  ☆27Updated last year
• EnnengYang / Efficient-WEMoE
  Efficient and Effective Weight-Ensembling Mixture of Experts for Multi-Task Model Merging. Arxiv, 2024.
  ☆13Updated 7 months ago
• EnnengYang / RepresentationSurgery
  Representation Surgery for Multi-Task Model Merging. ICML, 2024.
  ☆45Updated 8 months ago
• pilancilab / Riemannian_Preconditioned_LoRA
  source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"
  ☆26Updated last year
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆83Updated 7 months ago
• VijayLingam95 / SVFT
  ☆29Updated 4 months ago
• tanganke / opcm
  ☆13Updated 4 months ago
• duguodong7 / pcb-merging
  [NeurIPS 2024] For paper Parameter Competition Balancing for Model Merging
  ☆41Updated 8 months ago
• gortizji / tangent_task_arithmetic
  Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".
  ☆102Updated 2 years ago
• deeplearning-wisc / haloscope
  source code for NeurIPS'24 paper "HaloScope: Harnessing Unlabeled LLM Generations for Hallucination Detection"
  ☆46Updated 2 months ago
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆88Updated 8 months ago
• MohammadrezaBanaei / LoRA-XS
  LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters
  ☆35Updated 3 months ago
• tmlr-group / NoisyRationales
  [NeurIPS 2024] "Can Language Models Perform Robust Reasoning in Chain-of-thought Prompting with Noisy Rationales?"
  ☆34Updated 5 months ago
• QingyangZhang / EMPO
  EMPO, A Fully Unsupervised RLVR Method
  ☆40Updated 2 weeks ago
• zepingyu0512 / in-context-mechanism
  code for EMNLP 2024 paper: How do Large Language Models Learn In-Context? Query and Key Matrices of In-Context Heads are Two Towers for M…
  ☆12Updated 7 months ago
• NUS-HPC-AI-Lab / DD-Ranking
  Data distillation benchmark
  ☆66Updated last week
• yule-BUAA / MergeLLM
  Codes for Merging Large Language Models
  ☆32Updated 10 months ago
• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆38Updated 8 months ago
• hkust-nlp / PEM_composition
  [NeurIPS 2023] Github repository for "Composing Parameter-Efficient Modules with Arithmetic Operations"
  ☆61Updated last year
• adymaharana / d2pruning
  ☆35Updated last year
• ZFancy / DivOE
  [NeurIPS 2023] "Diversified Outlier Exposure for Out-of-Distribution Detection via Informative Extrapolation"
  ☆11Updated last year
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆92Updated 9 months ago
• ArthurLeoM / peft-givens
  source code of (quasi-)Givens Orthogonal Fine Tuning integrated to peft lib
  ☆17Updated 3 months ago