MrGGLS / BlockPrunerLinks
A block pruning framework for LLMs.
☆24Updated 2 months ago
Alternatives and similar repositories for BlockPruner
Users that are interested in BlockPruner are comparing it to the libraries listed below
Sorting:
- ☆18Updated 7 months ago
- Official implementation of the ICLR paper "Streamlining Redundant Layers to Compress Large Language Models"☆30Updated 2 months ago
- Official implementation for LaCo (EMNLP 2024 Findings)☆17Updated 9 months ago
- [ICLR 2025] Official implementation of paper "Dynamic Low-Rank Sparse Adaptation for Large Language Models".☆19Updated 4 months ago
- Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…☆49Updated last year
- [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference☆43Updated last year
- Representation Surgery for Multi-Task Model Merging. ICML, 2024.☆45Updated 9 months ago
- Codes for Merging Large Language Models☆32Updated 11 months ago
- [AAAI 2024] Fluctuation-based Adaptive Structured Pruning for Large Language Models☆56Updated last year
- [EMNLP 2023, Main Conference] Sparse Low-rank Adaptation of Pre-trained Language Models☆79Updated last year
- AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.☆86Updated 8 months ago
- ☆58Updated last year
- Inference Code for Paper "Harder Tasks Need More Experts: Dynamic Routing in MoE Models"☆56Updated 11 months ago
- CoT-Valve: Length-Compressible Chain-of-Thought Tuning☆76Updated 5 months ago
- LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning☆31Updated last year
- ☆56Updated 7 months ago
- Awesome LLM pruning papers all-in-one repository with integrating all useful resources and insights.☆96Updated 7 months ago
- Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)☆64Updated 3 months ago
- [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging☆59Updated 4 months ago
- Codebase for decoding compressed trust.☆24Updated last year
- Unofficial implementations of block/layer-wise pruning methods for LLMs.☆72Updated last year
- Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "☆126Updated 3 months ago
- TokenSkip: Controllable Chain-of-Thought Compression in LLMs☆164Updated 2 weeks ago
- code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"☆19Updated 4 months ago
- ☆15Updated 8 months ago
- [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retenti…☆65Updated last year
- Awesome-Low-Rank-Adaptation☆110Updated 9 months ago
- [ICLR 2025🔥] D2O: Dynamic Discriminative Operations for Efficient Long-Context Inference of Large Language Models☆18Updated last week
- ☆20Updated last year
- ☆33Updated last year