Alternatives and similar repositories for Pruning-via-Merging:

Users that are interested in Pruning-via-Merging are comparing it to the libraries listed below

• MrGGLS / BlockPruner
  A block pruning framework for LLMs.
  ☆15Updated 5 months ago
• ylsung / ECoFLaP
  Code for "ECoFLaP: Efficient Coarse-to-Fine Layer-Wise Pruning for Vision-Language Models" (ICLR 2024)
  ☆18Updated 10 months ago
• harveyhuang18 / EMR_Merging
  [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging
  ☆35Updated last month
• LZY-the-boys / Twin-Merging
  [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging
  ☆43Updated 2 weeks ago
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆56Updated last month
• ChasonShi / MELoRA
  code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"
  ☆15Updated 7 months ago
• cliang1453 / task-aware-distillation
  Less is More: Task-aware Layer-wise Distillation for Language Model Compression (ICML2023)
  ☆30Updated last year
• GATECH-EIC / ACT
  [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…
  ☆27Updated 5 months ago
• UNITES-Lab / MC-SMoE
  [ICLR 2024 Spotlight] Code for the paper "Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy"
  ☆67Updated 6 months ago
• r-three / smear
  ☆27Updated last year
• which47 / LLMCL
  Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient Tuning
  ☆25Updated last month
• song-wx / SIFT
  [ICML2024 Spotlight] Fine-Tuning Pre-trained Large Language Models Sparsely
  ☆19Updated 5 months ago
• yxli2123 / LoSparse
  ☆49Updated last year
• lliai / Awesome-LoRA-Low-Rank-Adaptation
  Awesome-Low-Rank-Adaptation
  ☆51Updated 2 months ago
• zyxxmu / DSnoT
  Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…
  ☆37Updated 8 months ago
• raymin0223 / fast_robust_early_exit
  Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)
  ☆56Updated 2 months ago
• PKU-ML / LongPPL
  ☆23Updated last month
• yule-BUAA / MergeLLM
  Codes for Merging Large Language Models
  ☆25Updated 4 months ago
• FeiyuZhang98 / IncreLoRA
  ☆30Updated last year
• BaiTheBest / SparseLLM
  Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)
  ☆45Updated last month
• nik-dim / tall_masks
  Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]
  ☆36Updated last month
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆130Updated 9 months ago
• princeton-nlp / Edge-Pruning
  [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".
  ☆29Updated last week
• adymaharana / d2pruning
  ☆31Updated last year
• alisawuffles / proxy-tuning
  Code associated with Tuning Language Models by Proxy (Liu et al., 2024)
  ☆99Updated 8 months ago
• htqin / IR-QLoRA
  [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retenti…
  ☆59Updated 8 months ago
• zjunlp / KnowledgeCircuits
  [NeurIPS 2024] Knowledge Circuits in Pretrained Transformers
  ☆87Updated 3 weeks ago
• ROIM1998 / APT
  [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference
  ☆28Updated 6 months ago
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆15Updated 6 months ago
• yfqiu-nlp / sea-llm
  Code for the paper "Spectral Editing of Activations for Large Language Model Alignments"
  ☆17Updated 5 months ago