aim-uofa / LoRAPrune

Related projects: ⓘ

• ROIM1998 / APT
  [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference
  ☆21Updated 3 months ago
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆71Updated this week
• htqin / IR-QLoRA
  [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retenti…
  ☆55Updated 5 months ago
• pprp / Awesome-LLM-Prune
  Awesome list for LLM pruning.
  ☆130Updated 3 weeks ago
• zyxxmu / DSnoT
  Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…
  ☆31Updated 5 months ago
• yxli2123 / LoSparse
  ☆44Updated 11 months ago
• nbasyl / DoRA
  Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"
  ☆120Updated 4 months ago
• A-suozhang / Awesome-Efficient-Diffusion
  Curated list of methods that focuses on improving the efficiency of diffusion models
  ☆26Updated 2 months ago
• yushuiwx / MoLE
  ☆40Updated 5 months ago
• TsinghuaC3I / SoRA
  The source code of the EMNLP 2023 main conference paper: Sparse Low-rank Adaptation of Pre-trained Language Models.
  ☆62Updated 6 months ago
• sdc17 / UPop
  [ICML 2023] UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers.
  ☆94Updated 10 months ago
• ArthurLeoM / peft-givens
  source code of (quasi-)Givens Orthogonal Fine Tuning integrated to peft lib
  ☆12Updated this week
• UNITES-Lab / MC-SMoE
  [ICLR 2024 Spotlight] Code for the paper "Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy"
  ☆63Updated 3 months ago
• tanganke / fusion_bench
  FusionBench: A Comprehensive Benchmark of Deep Model Fusion
  ☆42Updated 2 weeks ago
• pixeli99 / OwLore
  Official Pytorch Implementation of "OwLore: Outlier-weighed Layerwise Sampled Low-Rank Projection for Memory-Efficient LLM Fine-tuning" b…
  ☆21Updated 3 months ago
• luuyin / OWL
  Official Pytorch Implementation of "Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity"
  ☆49Updated 2 months ago
• TianjinYellow / EdgeDeviceLLMCompetition-Starting-Kit
  ☆38Updated 2 weeks ago
• wutaiqiang / MoSLoRA
  ☆54Updated 2 months ago
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆104Updated 6 months ago
• ylsung / ECoFLaP
  Code for "ECoFLaP: Efficient Coarse-to-Fine Layer-Wise Pruning for Vision-Language Models" (ICLR 2024)
  ☆15Updated 7 months ago
• NUS-HPC-AI-Lab / DATM
  ICLR 2024, Towards Lossless Dataset Distillation via Difficulty-Aligned Trajectory Matching
  ☆87Updated 3 months ago
• VITA-Group / BackRazor_Neurips22
  [Neurips 2022] “ Back Razor: Memory-Efficient Transfer Learning by Self-Sparsified Backpropogation”, Ziyu Jiang*, Xuxi Chen*, Xueqin Huan…
  ☆19Updated last year
• CASIA-IVA-Lab / FLAP
  [AAAI 2024] Fluctuation-based Adaptive Structured Pruning for Large Language Models
  ☆34Updated 8 months ago
• hahnyuan / ASVD4LLM
  Activation-aware Singular Value Decomposition for Compressing Large Language Models
  ☆43Updated 3 weeks ago
• VITA-Group / LiGO
  [ICLR 2023] "Learning to Grow Pretrained Models for Efficient Transformer Training" by Peihao Wang, Rameswar Panda, Lucas Torroba Hennige…
  ☆81Updated 6 months ago
• ThisisBillhe / EfficientDM
  [ICLR 2024 Spotlight] This is the official PyTorch implementation of "EfficientDM: Efficient Quantization-Aware Fine-Tuning of Low-Bit Di…
  ☆49Updated 3 months ago
• biomedical-cybernetics / Relative-importance-and-activation-pruning
  ☆27Updated 3 months ago
• lzhxmu / VTW
  ☆20Updated last month
• GCYZSL / MoLA
  ☆110Updated last month
• gortizji / tangent_task_arithmetic
  Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".
  ☆79Updated last year