aim-uofa / LoRAPrune

Related projects ⓘ

Alternatives and complementary repositories for LoRAPrune

• ROIM1998 / APT
  [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference
  ☆28Updated 5 months ago
• zyxxmu / DSnoT
  Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…
  ☆37Updated 7 months ago
• ldery / Bonsai
  Code for "Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes"
  ☆28Updated 7 months ago
• yxli2123 / LoSparse
  ☆47Updated last year
• htqin / IR-QLoRA
  [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retenti…
  ☆59Updated 7 months ago
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆123Updated 8 months ago
• lliai / Awesome-LoRA-Low-Rank-Adaptation
  Awesome-Low-Rank-Adaptation
  ☆40Updated last month
• MrGGLS / BlockPruner
  A block pruning framework for LLMs.
  ☆12Updated 5 months ago
• ylsung / ECoFLaP
  Code for "ECoFLaP: Efficient Coarse-to-Fine Layer-Wise Pruning for Vision-Language Models" (ICLR 2024)
  ☆17Updated 9 months ago
• tanganke / peta
  Code for paper "Parameter Efficient Multi-task Model Fusion with Partial Linearization"
  ☆14Updated 2 months ago
• TsinghuaC3I / SoRA
  [EMNLP 2023 Main] Sparse Low-rank Adaptation of Pre-trained Language Models
  ☆70Updated 8 months ago
• VILA-Lab / GBLM-Pruner
  Are gradient information useful for pruning of LLMs?
  ☆38Updated 7 months ago
• CASIA-IVA-Lab / FLAP
  [AAAI 2024] Fluctuation-based Adaptive Structured Pruning for Large Language Models
  ☆37Updated 10 months ago
• harveyhuang18 / EMR_Merging
  [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging
  ☆32Updated last month
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆83Updated 2 months ago
• nbasyl / DoRA
  Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"
  ☆122Updated 6 months ago
• UNITES-Lab / MC-SMoE
  [ICLR 2024 Spotlight] Code for the paper "Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy"
  ☆64Updated 5 months ago
• A-suozhang / Awesome-Efficient-Diffusion
  Curated list of methods that focuses on improving the efficiency of diffusion models
  ☆30Updated 4 months ago
• NUS-HPC-AI-Lab / DATM
  ICLR 2024, Towards Lossless Dataset Distillation via Difficulty-Aligned Trajectory Matching
  ☆94Updated 6 months ago
• mrflogs / LoRA-Pro
  Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "
  ☆74Updated last month
• sdc17 / UPop
  [ICML 2023] UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers.
  ☆99Updated last year
• ArthurLeoM / peft-givens
  source code of (quasi-)Givens Orthogonal Fine Tuning integrated to peft lib
  ☆13Updated 2 months ago
• hahnyuan / ASVD4LLM
  Activation-aware Singular Value Decomposition for Compressing Large Language Models
  ☆49Updated last month
• TianjinYellow / EdgeDeviceLLMCompetition-Starting-Kit
  ☆39Updated 3 weeks ago
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆52Updated 3 weeks ago
• jiwonsong-dev / SLEB
  Official Implementation of SLEB: Streamlining LLMs through Redundancy Verification and Elimination of Transformer Blocks
  ☆31Updated 4 months ago
• luuyin / OWL
  Official Pytorch Implementation of "Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity"
  ☆51Updated 4 months ago
• nik-dim / tall_masks
  Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]
  ☆36Updated 3 weeks ago
• Hsu1023 / DuQuant
  [NeurIPS 2024 Oral🔥] DuQuant: Distributing Outliers via Dual Transformation Makes Stronger Quantized LLMs.
  ☆110Updated last month