Alternatives and similar repositories for Awesome-LoRA-Low-Rank-Adaptation:

Users that are interested in Awesome-LoRA-Low-Rank-Adaptation are comparing it to the libraries listed below

• Clin0212 / HydraLoRA
  [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
  ☆160Updated 2 months ago
• wutaiqiang / MoSLoRA
  ☆93Updated 7 months ago
• TsinghuaC3I / SoRA
  [EMNLP 2023 Main] Sparse Low-rank Adaptation of Pre-trained Language Models
  ☆72Updated 11 months ago
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆89Updated 5 months ago
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆65Updated 3 months ago
• harveyhuang18 / EMR_Merging
  [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging
  ☆44Updated 3 months ago
• aim-uofa / LoRAPrune
  ☆46Updated 2 months ago
• mrflogs / LoRA-Pro
  Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "
  ☆101Updated 3 months ago
• GCYZSL / MoLA
  ☆123Updated 6 months ago
• zyxxmu / DSnoT
  Official Pytorch Implementation of Our Paper Accepted at ICLR 2024-- Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLM…
  ☆43Updated 10 months ago
• iboing / CorDA
  CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for task-aware parameter-efficient fine-tuning(NeurIPS 2024)
  ☆42Updated last month
• ChasonShi / MELoRA
  code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"
  ☆16Updated this week
• SempraETY / Pruning-via-Merging
  ☆17Updated 2 months ago
• Yuheng2000 / Awesome-LoRA
  Awesome Low-Rank Adaptation
  ☆28Updated 5 months ago
• Chongjie-Si / Subspace-Tuning
  A generalized framework for subspace tuning methods in parameter efficient fine-tuning.
  ☆128Updated 2 weeks ago
• ROIM1998 / APT
  [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference
  ☆34Updated 8 months ago
• tanganke / peta
  Code for paper "Parameter Efficient Multi-task Model Fusion with Partial Linearization"
  ☆18Updated 5 months ago
• htqin / IR-QLoRA
  [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retenti…
  ☆60Updated 10 months ago
• JingXuTHU / Random-Masking-Finds-Winning-Tickets-for-Parameter-Efficient-Fine-tuning
  ☆13Updated 9 months ago
• Chaos96 / fourierft
  ☆140Updated 5 months ago
• nik-dim / tall_masks
  Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]
  ☆39Updated 3 months ago
• LZY-the-boys / Twin-Merging
  [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging
  ☆48Updated 2 months ago
• NUS-HPC-AI-Lab / DATM
  ICLR 2024, Towards Lossless Dataset Distillation via Difficulty-Aligned Trajectory Matching
  ☆99Updated 8 months ago
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆49Updated 4 months ago
• TUDB-Labs / MixLoRA
  State-of-the-art Parameter-Efficient MoE Fine-tuning Method
  ☆130Updated 5 months ago
• VT-NLP / MixLoRA
  Multimodal Instruction Tuning with Conditional Mixture of LoRA (ACL 2024)
  ☆13Updated 6 months ago
• ZO-Bench / ZO-LLM
  [ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".
  ☆86Updated 7 months ago
• yangyifei729 / LaCo
  Official implementation for LaCo (EMNLP 2024 Findings)
  ☆12Updated 4 months ago
• circle-hit / SAPT
  Code for ACL 2024 accepted paper titled "SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language …
  ☆29Updated last month
• EnnengYang / RepresentationSurgery
  Representation Surgery for Multi-Task Model Merging. ICML, 2024.
  ☆38Updated 4 months ago