Alternatives and similar repositories for Awesome-LLM-LoRA

Users that are interested in Awesome-LLM-LoRA are comparing it to the libraries listed below

• Clin0212 / HydraLoRA
  [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
  ☆222Updated 10 months ago
• LINs-lab / DynMoE
  [ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models
  ☆136Updated 2 months ago
• wutaiqiang / MoSLoRA
  ☆117Updated last year
• gyhdog99 / MoCLE
  MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)
  ☆43Updated 3 months ago
• TUDB-Labs / MixLoRA
  State-of-the-art Parameter-Efficient MoE Fine-tuning Method
  ☆188Updated last year
• Chongjie-Si / Subspace-Tuning
  A generalized framework for subspace tuning methods in parameter efficient fine-tuning.
  ☆155Updated 3 months ago
• Yuheng2000 / Awesome-LoRA
  Awesome Low-Rank Adaptation
  ☆45Updated last month
• GCYZSL / MoLA
  ☆158Updated last year
• liuqidong07 / MOELoRA-peft
  [SIGIR'24] The official implementation code of MOELoRA.
  ☆181Updated last year
• THUDM / Awesome-Parameter-Efficient-Fine-Tuning-for-Foundation-Models
  Parameter-Efficient Fine-Tuning for Foundation Models
  ☆93Updated 6 months ago
• lliai / LoRA-Zoo
  Awesome-Low-Rank-Adaptation
  ☆118Updated 11 months ago
• qianlima-lab / awesome-lifelong-learning-methods-for-llm
  This repository collects awesome survey, resource, and paper for Lifelong Learning for Large Language Models. (Updated Regularly)
  ☆65Updated 4 months ago
• zzz47zzz / spurious-forgetting
  [ICLR 2025] Released code for paper "Spurious Forgetting in Continual Learning of Language Models"
  ☆52Updated 4 months ago
• MingyuJ666 / Rope_with_LLM
  [ICML'25] Our study systematically investigates massive values in LLMs' attention mechanisms. First, we observe massive values are concen…
  ☆80Updated 3 months ago
• cmnfriend / O-LoRA
  ☆186Updated last year
• Chaos96 / fourierft
  ☆148Updated last year
• testtimescaling / testtimescaling.github.io
  "what, how, where, and how well? a survey on test-time scaling in large language models" repository
  ☆70Updated last week
• ZhenweiAn / Dynamic_MoE
  Inference Code for Paper "Harder Tasks Need More Experts: Dynamic Routing in MoE Models"
  ☆64Updated last year
• Outsider565 / LoRA-GA
  ☆209Updated 11 months ago
• fscdc / Awesome-Efficient-Reasoning-Models
  [TMLR 2025] Efficient Reasoning Models: A Survey
  ☆265Updated this week
• Ablustrund / LoRAMoE
  LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment
  ☆374Updated last year
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆86Updated 7 months ago
• QingyangZhang / Label-Free-RLVR
  ☆269Updated 2 months ago
• scale-lab / MTLoRA
  The official implementation for MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning (CVPR '24)
  ☆65Updated 3 months ago
• TsinghuaC3I / SoRA
  [EMNLP 2023, Main Conference] Sparse Low-rank Adaptation of Pre-trained Language Models
  ☆83Updated last year
• Osilly / dynamic_llava
  [ICLR 2025] The official pytorch implement of "Dynamic-LLaVA: Efficient Multimodal Large Language Models via Dynamic Vision-language Cont…
  ☆56Updated 2 weeks ago
• TUDB-Labs / MoE-PEFT
  An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT
  ☆118Updated 6 months ago
• MLNLP-World / Academic-Resume-Template
  学术双语简历模板，涵盖教育背景、论文发表、项目经历、竞赛经历和个人陈述等关键部分，可适用于申请研究生项目、学术职位或相关行业岗位。
  ☆127Updated 3 months ago
• NiuTrans / Vision-LLM-Alignment
  This repository contains the code for SFT, RLHF, and DPO, designed for vision-based LLMs, including the LLaVA models and the LLaMA-3.2-vi…
  ☆114Updated 3 months ago
• beccabai / Data-centric_multimodal_LLM
  Survey on Data-centric Large Language Models
  ☆84Updated last year