Alternatives and similar repositories for MELoRA:

Users that are interested in MELoRA are comparing it to the libraries listed below

• GCYZSL / MoLA
  ☆123Updated 6 months ago
• circle-hit / SAPT
  Code for ACL 2024 accepted paper titled "SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language …
  ☆29Updated last month
• sail-sg / sdft
  [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".
  ☆110Updated 3 months ago
• GATECH-EIC / ACT
  [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…
  ☆31Updated 7 months ago
• Shwai-He / MEO
  The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":
  ☆35Updated 10 months ago
• harveyhuang18 / EMR_Merging
  [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging
  ☆44Updated 3 months ago
• yule-BUAA / MergeLLM
  Codes for Merging Large Language Models
  ☆29Updated 6 months ago
• SempraETY / Pruning-via-Merging
  ☆17Updated 2 months ago
• LZY-the-boys / Twin-Merging
  [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging
  ☆48Updated 2 months ago
• Yuheng2000 / Awesome-LoRA
  Awesome Low-Rank Adaptation
  ☆28Updated 5 months ago
• mrflogs / LoRA-Pro
  Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "
  ☆102Updated 3 months ago
• VT-NLP / MixLoRA
  Multimodal Instruction Tuning with Conditional Mixture of LoRA (ACL 2024)
  ☆13Updated 6 months ago
• OpenSparseLLMs / CLIP-MoE
  CLIP-MoE: Mixture of Experts for CLIP
  ☆23Updated 4 months ago
• ZhengxiangShi / DePT
  [ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"
  ☆96Updated 10 months ago
• RainBowLuoCS / DEEM
  (ICLR2025 Spotlight) DEEM: Official implementation of Diffusion models serve as the eyes of large language models for image perception.
  ☆18Updated 2 months ago
• hychaochao / EMMA
  The official repository for the paper "Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmark"
  ☆42Updated 3 weeks ago
• TsinghuaC3I / SoRA
  [EMNLP 2023 Main] Sparse Low-rank Adaptation of Pre-trained Language Models
  ☆72Updated 11 months ago
• TUDB-Labs / MoE-PEFT
  An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT
  ☆69Updated 3 weeks ago
• SUSTechBruce / LOOK-M
  [EMNLP 2024 Findings🔥] Official implementation of "LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context Infe…
  ☆91Updated 3 months ago
• LightChen233 / M3CoT
  ☆61Updated 8 months ago
• gyhdog99 / MoCLE
  MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)
  ☆33Updated 10 months ago
• which47 / LLMCL
  Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient Tuning
  ☆29Updated 3 months ago
• Shwai-He / SparseAdapter
  Source code of EMNLP 2022 Findings paper "SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters"
  ☆18Updated 10 months ago
• mathllm / Step-Controlled_DPO
  ☆20Updated 7 months ago
• wutaiqiang / MoSLoRA
  ☆93Updated 7 months ago
• hkust-nlp / mstar
  M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning
  ☆55Updated last month
• SihengLi99 / LLM-Honesty-Survey
  A Survey on the Honesty of Large Language Models
  ☆53Updated 2 months ago