Alternatives and similar repositories for model_merging:

Users that are interested in model_merging are comparing it to the libraries listed below

• gortizji / tangent_task_arithmetic
  Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".
  ☆92Updated last year
• logix-project / logix
  AI Logging for Interpretability and Explainability🔬
  ☆97Updated 7 months ago
• nik-dim / tall_masks
  Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]
  ☆39Updated 2 months ago
• r-three / mats
  ☆27Updated 6 months ago
• Thartvigsen / GRACE
  [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors
  ☆71Updated 3 weeks ago
• aviclu / ffn-values
  ☆61Updated last year
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆89Updated 3 years ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆80Updated last year
• ykwon0407 / DataInf
  DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models (ICLR 2024)
  ☆57Updated 3 months ago
• tml-epfl / long-is-more-for-alignment
  Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]
  ☆17Updated 8 months ago
• UKPLab / iclr2024-model-merging
  This is the repository for "Model Merging by Uncertainty-Based Gradient Matching", ICLR 2024.
  ☆24Updated 8 months ago
• KihoPark / linear_rep_geometry
  ☆82Updated 11 months ago
• roeehendel / icl_task_vectors
  ☆85Updated last year
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆61Updated 2 months ago
• abhishekpanigrahi1996 / Skill-Localization-by-grafting
  ☆47Updated last year
• ejones313 / auditing-llms
  ☆51Updated last year
• fc2869 / lo-fit
  LoFiT: Localized Fine-tuning on LLM Representations
  ☆30Updated this week
• locuslab / acr-memorization
  ☆30Updated 3 weeks ago
• varunnair18 / FISH
  Code for "Training Neural Networks with Fixed Sparse Masks" (NeurIPS 2021).
  ☆58Updated 3 years ago
• AkariAsai / ATTEMPT
  This is the oficial repository for "Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts" (EMNLP 2022)
  ☆100Updated 2 years ago
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆61Updated 2 months ago
• princeton-nlp / LM-Kernel-FT
  A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643
  ☆74Updated last year
• bloomberg / dataless-model-merging
  Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)
  ☆86Updated last year
• guy-dar / embedding-space
  ☆52Updated last year
• TRAIS-Lab / dattri
  `dattri` is a PyTorch library for developing, benchmarking, and deploying efficient data attribution algorithms.
  ☆55Updated 2 weeks ago
• deeplearning-wisc / args
  ☆34Updated 11 months ago
• paul-rottger / exaggerated-safety
  Röttger et al. (2023): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"
  ☆77Updated last year
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆133Updated 10 months ago
• locuslab / tofu
  Landing Page for TOFU
  ☆107Updated 3 weeks ago
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆131Updated 3 months ago