graldij / transformer-fusion

Related projects ⓘ

Alternatives and complementary repositories for transformer-fusion

• abhishekpanigrahi1996 / Skill-Localization-by-grafting
  ☆44Updated 10 months ago
• licong-lin / negative-preference-optimization
  ☆35Updated 4 months ago
• nik-dim / tall_masks
  Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]
  ☆35Updated 3 weeks ago
• hkust-nlp / PEM_composition
  [NeurIPS 2023] Github repository for "Composing Parameter-Efficient Modules with Arithmetic Operations"
  ☆58Updated 11 months ago
• JingXuTHU / Random-Masking-Finds-Winning-Tickets-for-Parameter-Efficient-Fine-tuning
  ☆11Updated 6 months ago
• Thartvigsen / GRACE
  [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors
  ☆69Updated 9 months ago
• yaojin17 / Unlearning_LLM
  [ACL 2024] Code and data for "Machine Unlearning of Pre-trained Large Language Models"
  ☆47Updated last month
• roeehendel / icl_task_vectors
  ☆81Updated last year
• TRAIS-Lab / dattri
  `dattri` is a PyTorch library for developing, benchmarking, and deploying efficient data attribution algorithms.
  ☆32Updated 2 weeks ago
• xydaytoy / EVA
  ☆11Updated 7 months ago
• gortizji / tangent_task_arithmetic
  Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".
  ☆87Updated last year
• Glaciohound / LM-Steer
  Official Code Repository for LM-Steer Paper: "Word Embeddings Are Steers for Language Models" (ACL 2024 Outstanding Paper Award)
  ☆62Updated last month
• UKPLab / iclr2024-model-merging
  This is the repository for "Model Merging by Uncertainty-Based Gradient Matching", ICLR 2024.
  ☆21Updated 6 months ago
• dannyallover / overthinking_the_truth
  ☆26Updated 6 months ago
• harveyhuang18 / EMR_Merging
  [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging
  ☆31Updated last month
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆44Updated last year
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆119Updated last month
• zhenyuhe00 / BiPE
  Two Stones Hit One Bird: Bilevel Positional Encoding for Better Length Extrapolation, ICML 2024
  ☆21Updated 4 months ago
• zjunlp / KnowledgeCircuits
  [NeurIPS 2024] Knowledge Circuits in Pretrained Transformers
  ☆75Updated last month
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆83Updated 2 months ago
• TsinghuaC3I / SoRA
  [EMNLP 2023 Main] Sparse Low-rank Adaptation of Pre-trained Language Models
  ☆69Updated 8 months ago
• boyiwei / CoTaEval
  Official code for the paper: Evaluating Copyright Takedown Methods for Language Models
  ☆15Updated 4 months ago
• EnnengYang / RepresentationSurgery
  Representation Surgery for Multi-Task Model Merging. ICML, 2024.
  ☆28Updated last month
• hkust-nlp / Activation_Decoding
  In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation (ICML 2024)
  ☆45Updated 7 months ago
• mmatena / model_merging
  ☆63Updated 2 years ago
• LZY-the-boys / Twin-Merging
  [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging
  ☆36Updated this week
• Shwai-He / MEO
  The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":
  ☆35Updated 7 months ago
• UCSB-NLP-Chang / llm_uncertainty
  ☆26Updated 9 months ago
• jaechan-repo / muse_bench
  ☆12Updated 3 months ago
• r-three / smear
  ☆27Updated last year