mmatena / model_merging

Related projects ⓘ

Alternatives and complementary repositories for model_merging

• gortizji / tangent_task_arithmetic
  Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".
  ☆87Updated last year
• r-three / mats
  ☆25Updated 4 months ago
• logix-project / logix
  AI Logging for Interpretability and Explainability🔬
  ☆89Updated 5 months ago
• roeehendel / icl_task_vectors
  ☆81Updated last year
• Thartvigsen / GRACE
  [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors
  ☆69Updated 8 months ago
• ykwon0407 / DataInf
  DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models (ICLR 2024)
  ☆53Updated last month
• nik-dim / tall_masks
  Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]
  ☆35Updated 3 weeks ago
• socialfoundations / tttlm
  Test-time-training on nearest neighbors for large language models
  ☆27Updated 7 months ago
• abhishekpanigrahi1996 / Skill-Localization-by-grafting
  ☆44Updated 10 months ago
• UKPLab / iclr2024-model-merging
  This is the repository for "Model Merging by Uncertainty-Based Gradient Matching", ICLR 2024.
  ☆21Updated 6 months ago
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆54Updated 2 weeks ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆79Updated last year
• prateeky2806 / ties-merging
  ☆151Updated 9 months ago
• bloomberg / dataless-model-merging
  Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)
  ☆85Updated last year
• varunnair18 / FISH
  Code for "Training Neural Networks with Fixed Sparse Masks" (NeurIPS 2021).
  ☆56Updated 2 years ago
• tml-epfl / long-is-more-for-alignment
  Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]
  ☆15Updated 6 months ago
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆85Updated 3 years ago
• AkariAsai / ATTEMPT
  This is the oficial repository for "Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts" (EMNLP 2022)
  ☆97Updated last year
• rabeehk / compacter
  ☆126Updated 2 years ago
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆53Updated 3 weeks ago
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆119Updated last month
• locuslab / tofu
  Landing Page for TOFU
  ☆98Updated 5 months ago
• dannyallover / overthinking_the_truth
  ☆26Updated 6 months ago
• mlepori1 / NeuroSurgeon
  NeuroSurgeon is a package that enables researchers to uncover and manipulate subnetworks within models in Huggingface Transformers
  ☆36Updated 3 months ago
• automl / is_mamba_capable_of_icl
  ☆13Updated 6 months ago
• aviclu / ffn-values
  ☆58Updated last year
• benzakenelad / BitFit
  Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
  ☆133Updated 2 years ago
• microsoft / mttl
  Building modular LMs with parameter-efficient fine-tuning.
  ☆83Updated this week
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆44Updated last year
• locuslab / acr-memorization
  ☆26Updated 3 weeks ago