Alternatives and similar repositories for MELoRA:

Users that are interested in MELoRA are comparing it to the libraries listed below

• circle-hit / SAPT
  Code for ACL 2024 accepted paper titled "SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language …
  ☆33Updated 2 months ago
• GCYZSL / MoLA
  ☆131Updated 8 months ago
• gyhdog99 / MoCLE
  MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)
  ☆34Updated 11 months ago
• liuqidong07 / MOELoRA-peft
  [SIGIR'24] The official implementation code of MOELoRA.
  ☆153Updated 8 months ago
• hemingkx / TokenSkip
  TokenSkip: Controllable Chain-of-Thought Compression in LLMs
  ☆98Updated 2 weeks ago
• wutaiqiang / MoSLoRA
  ☆100Updated 8 months ago
• Bumble666 / Hyper_MoE
  ☆25Updated 2 months ago
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆55Updated last month
• mlwu22 / RED
  Implementation code for ACL2024：Advancing Parameter Efficiency in Fine-tuning via Representation Editing
  ☆13Updated 11 months ago
• sail-sg / sdft
  [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".
  ☆116Updated 4 months ago
• ZhengxiangShi / DePT
  [ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"
  ☆96Updated 11 months ago
• mrflogs / LoRA-Pro
  Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "
  ☆106Updated 2 weeks ago
• Shwai-He / MEO
  The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":
  ☆36Updated 11 months ago
• r-three / smear
  ☆27Updated last year
• VT-NLP / MixLoRA
  Multimodal Instruction Tuning with Conditional Mixture of LoRA (ACL 2024)
  ☆14Updated 7 months ago
• cmnfriend / O-LoRA
  ☆170Updated 8 months ago
• Shwai-He / SparseAdapter
  Source code of EMNLP 2022 Findings paper "SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters"
  ☆18Updated 11 months ago
• SempraETY / Pruning-via-Merging
  ☆17Updated 4 months ago
• zzz47zzz / spurious-forgetting
  [ICLR 2025] Released code for paper "Spurious Forgetting in Continual Learning of Language Models"
  ☆28Updated last month
• DavidFanzz / SCMoE
  ☆19Updated 10 months ago
• xinghaow99 / DenoSent
  [AAAI 2024] DenoSent: A Denoising Objective for Self-Supervised Sentence Representation Learning
  ☆15Updated 10 months ago
• ZNLP / Language-Imbalance-Driven-Rewarding
  Language Imbalance Driven Rewarding for Multilingual Self-improving
  ☆15Updated 4 months ago
• alenai97 / PEFT-MLLM
  Official Code and data for ACL 2024 finding, "An Empirical Study on Parameter-Efficient Fine-Tuning for MultiModal Large Language Models"
  ☆16Updated 4 months ago
• OpenMOSS / Say-I-Dont-Know
  [ICML'2024] Can AI Assistants Know What They Don't Know?
  ☆78Updated last year
• FeiyuZhang98 / IncreLoRA
  ☆31Updated last year
• ChaosCodes / ProPETL
  One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning
  ☆39Updated last year
• yule-BUAA / MergeLLM
  Codes for Merging Large Language Models
  ☆29Updated 7 months ago
• DRSY / EMO
  [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)
  ☆119Updated last year
• LightChen233 / M3CoT
  ☆64Updated 9 months ago
• TianyunYoung / Hallucination-Attribution
  This repo contains the code for the paper "Understanding and Mitigating Hallucinations in Large Vision-Language Models via Modular Attrib…
  ☆12Updated 2 weeks ago