Alternatives and similar repositories for BlockPruner

Users that are interested in BlockPruner are comparing it to the libraries listed below

• SempraETY / Pruning-via-Merging
  ☆18Updated 7 months ago
• RUCKBReasoning / LLM-Streamline
  Official implementation of the ICLR paper "Streamlining Redundant Layers to Compress Large Language Models"
  ☆29Updated last month
• yangyifei729 / LaCo
  Official implementation for LaCo (EMNLP 2024 Findings)
  ☆17Updated 8 months ago
• zyxxmu / DSnoT
  Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…
  ☆47Updated last year
• harveyhuang18 / EMR_Merging
  [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging
  ☆59Updated 3 months ago
• VITA-Group / SEAL
  Official code for SEAL: Steerable Reasoning Calibration of Large Language Models for Free
  ☆28Updated 2 months ago
• EnnengYang / RepresentationSurgery
  Representation Surgery for Multi-Task Model Merging. ICML, 2024.
  ☆45Updated 8 months ago
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆83Updated 7 months ago
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆73Updated 4 months ago
• yule-BUAA / MergeLLM
  Codes for Merging Large Language Models
  ☆32Updated 10 months ago
• FeiyuZhang98 / IncreLoRA
  ☆33Updated last year
• declare-lab / della
  DELLA-Merging: Reducing Interference in Model Merging through Magnitude-Based Sampling
  ☆32Updated 11 months ago
• ZhenweiAn / Dynamic_MoE
  Inference Code for Paper "Harder Tasks Need More Experts: Dynamic Routing in MoE Models"
  ☆52Updated 10 months ago
• PositionalHidden / PositionalHidden
  To mitigate position bias in LLMs, especially in long-context scenarios, we scale only one dimension of LLMs, reducing position bias and …
  ☆11Updated last year
• tanganke / peta
  Code for paper "Parameter Efficient Multi-task Model Fusion with Partial Linearization"
  ☆21Updated 9 months ago
• yxli2123 / LoSparse
  ☆57Updated last year
• ArminAzizi98 / LaMDA
  ☆15Updated 7 months ago
• jiwonsong-dev / SLEB
  Official Implementation of SLEB: Streamlining LLMs through Redundancy Verification and Elimination of Transformer Blocks
  ☆37Updated 4 months ago
• wzhuang-xmu / LoSA
  [ICLR 2025] The official pytorch implement of "Dynamic Low-Rank Sparse Adaptation for Large Language Models".
  ☆19Updated 3 months ago
• peijunallin / alphalora
  ☆17Updated 7 months ago
• DavidFanzz / SCMoE
  ☆26Updated last year
• BaiTheBest / SparseLLM
  Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)
  ☆61Updated 2 months ago
• circle-hit / SAPT
  Code for ACL 2024 accepted paper titled "SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language …
  ☆35Updated 5 months ago
• lliai / Awesome-LoRA-Low-Rank-Adaptation
  Awesome-Low-Rank-Adaptation
  ☆104Updated 8 months ago
• ChasonShi / MELoRA
  code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"
  ☆19Updated 4 months ago
• bethgelab / sober-reasoning
  A Sober Look at Language Model Reasoning
  ☆74Updated last week
• Shwai-He / MEO
  The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":
  ☆39Updated last year
• LINs-lab / DynMoE
  [ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models
  ☆110Updated 4 months ago
• aim-uofa / LoRAPrune
  ☆55Updated 6 months ago
• songmzhang / DSKD
  Repo for the EMNLP'24 Paper "Dual-Space Knowledge Distillation for Large Language Models". A general white-box KD framework for both same…
  ☆54Updated 7 months ago