Alternatives and similar repositories for Awesome-LLM-LoRA:

Users that are interested in Awesome-LLM-LoRA are comparing it to the libraries listed below

• Yuheng2000 / Awesome-LoRA
  Awesome Low-Rank Adaptation
  ☆34Updated 6 months ago
• ChasonShi / MELoRA
  code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"
  ☆19Updated last month
• yule-BUAA / MergeLLM
  Codes for Merging Large Language Models
  ☆29Updated 7 months ago
• TUDB-Labs / MoE-PEFT
  An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT
  ☆82Updated 3 weeks ago
• lliai / Awesome-LoRA-Low-Rank-Adaptation
  Awesome-Low-Rank-Adaptation
  ☆87Updated 5 months ago
• wzhuang-xmu / LoSA
  [ICLR 2025] The official pytorch implement of "Dynamic Low-Rank Sparse Adaptation for Large Language Models".
  ☆12Updated 2 weeks ago
• BaiTheBest / SparseLLM
  Official Repo for SparseLLM: Global Pruning of LLMs (NeurIPS 2024)
  ☆52Updated this week
• scale-lab / MTLoRA
  The official implementation for MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning (CVPR '24)
  ☆44Updated 3 weeks ago
• ruz048 / AutoLoRA
  ☆10Updated 11 months ago
• Applied-Machine-Learning-Lab / MOELoRA-peft
  [SIGIR'24] The official implementation code of MOELoRA.
  ☆31Updated 8 months ago
• MrGGLS / BlockPruner
  A block pruning framework for LLMs.
  ☆21Updated 9 months ago
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆56Updated last month
• ZhenweiAn / Dynamic_MoE
  Inference Code for Paper "Harder Tasks Need More Experts: Dynamic Routing in MoE Models"
  ☆41Updated 8 months ago
• TsinghuaC3I / SoRA
  [EMNLP 2023 Main] Sparse Low-rank Adaptation of Pre-trained Language Models
  ☆72Updated last year
• ylsung / ECoFLaP
  Code for "ECoFLaP: Efficient Coarse-to-Fine Layer-Wise Pruning for Vision-Language Models" (ICLR 2024)
  ☆19Updated last year
• hemingkx / TokenSkip
  TokenSkip: Controllable Chain-of-Thought Compression in LLMs
  ☆103Updated 3 weeks ago
• GCYZSL / MoLA
  ☆131Updated 8 months ago
• ROIM1998 / APT
  [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference
  ☆33Updated 9 months ago
• RUCKBReasoning / LLM-Streamline
  Official implementation of the ICLR paper "Streamlining Redundant Layers to Compress Large Language Models"
  ☆14Updated 3 weeks ago
• zhang-wei-chao / DC-PDD
  This repository presents the original implementation of Pretraining Data Detection for Large Language Models: A Divergence-based Calibrat…
  ☆13Updated last month
• jianghoucheng / AlphaEdit
  ☆82Updated 3 months ago
• yangyifei729 / LaCo
  Official implementation for LaCo (EMNLP 2024 Findings)
  ☆16Updated 6 months ago
• EnnengYang / RepresentationSurgery
  Representation Surgery for Multi-Task Model Merging. ICML, 2024.
  ☆42Updated 5 months ago
• junkangwu / alpha-DPO
  ☆18Updated 5 months ago
• mrflogs / LoRA-Pro
  Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "
  ☆108Updated 3 weeks ago
• Osilly / dynamic_llava
  [ICLR 2025] The official pytorch implement of "Dynamic-LLaVA: Efficient Multimodal Large Language Models via Dynamic Vision-language Cont…
  ☆26Updated 4 months ago
• liuqidong07 / MOELoRA-peft
  [SIGIR'24] The official implementation code of MOELoRA.
  ☆155Updated 8 months ago
• CASIA-IVA-Lab / FLAP
  [AAAI 2024] Fluctuation-based Adaptive Structured Pruning for Large Language Models
  ☆45Updated last year
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆72Updated 5 months ago
• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆37Updated 5 months ago