Alternatives and similar repositories for AdaMoLE:

Users that are interested in AdaMoLE are comparing it to the libraries listed below

• TsinghuaC3I / SoRA
  [EMNLP 2023 Main] Sparse Low-rank Adaptation of Pre-trained Language Models
  ☆70Updated 10 months ago
• OpenSparseLLMs / CLIP-MoE
  CLIP-MoE: Mixture of Experts for CLIP
  ☆23Updated 3 months ago
• LZY-the-boys / Twin-Merging
  [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging
  ☆48Updated last month
• VT-NLP / MixLoRA
  Multimodal Instruction Tuning with Conditional Mixture of LoRA (ACL 2024)
  ☆12Updated 5 months ago
• harveyhuang18 / EMR_Merging
  [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging
  ☆43Updated 3 months ago
• GCYZSL / MoLA
  ☆122Updated 6 months ago
• Clin0212 / HydraLoRA
  [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
  ☆157Updated last month
• lliai / Awesome-LoRA-Low-Rank-Adaptation
  Awesome-Low-Rank-Adaptation
  ☆65Updated 3 months ago
• RayRuiboChen / Self-Filter
  ☆22Updated 7 months ago
• iboing / CorDA
  CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for task-aware parameter-efficient fine-tuning(NeurIPS 2024)
  ☆41Updated 2 weeks ago
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆59Updated 2 months ago
• sail-sg / MMCBench
  ☆27Updated last year
• gyhdog99 / MoCLE
  MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)
  ☆33Updated 9 months ago
• ZhengxiangShi / DePT
  [ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"
  ☆95Updated 9 months ago
• Qinyu-Allen-Zhao / LVLM-LP
  The First to Know: How Token Distributions Reveal Hidden Knowledge in Large Vision-Language Models?
  ☆23Updated 2 months ago
• which47 / LLMCL
  Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient Tuning
  ☆29Updated 2 months ago
• RainBowLuoCS / DEEM
  DEEM: Official implementation of Diffusion models serve as the eyes of large language models for image perception. (ICLR2025)
  ☆18Updated last month
• zjunlp / Deco
  [ICLR 2025] MLLM can see? Dynamic Correction Decoding for Hallucination Mitigation
  ☆33Updated last month
• yule-BUAA / MergeLLM
  Codes for Merging Large Language Models
  ☆28Updated 5 months ago
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View
  ☆46Updated 3 months ago
• wutaiqiang / MoSLoRA
  ☆92Updated 6 months ago
• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆32Updated last year
• luka-group / vlm-knowledge-conflict
  Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."
  ☆39Updated 3 months ago
• ChasonShi / MELoRA
  code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"
  ☆15Updated 8 months ago
• tanganke / peta
  Code for paper "Parameter Efficient Multi-task Model Fusion with Partial Linearization"
  ☆17Updated 4 months ago
• pipilurj / bootstrapped-preference-optimization-BPO
  code for "Strengthening Multimodal Large Language Model with Bootstrapped Preference Optimization"
  ☆53Updated 5 months ago
• Osilly / dynamic_llava
  [ICLR 2025] The official pytorch implement of "Dynamic-LLaVA: Efficient Multimodal Large Language Models via Dynamic Vision-language Cont…
  ☆17Updated last month
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆89Updated 4 months ago
• findalexli / mllm-dpo
  [ACL 2024] Multi-modal preference alignment remedies regression of visual instruction tuning on language model
  ☆33Updated 2 months ago
• Dongping-Chen / MLLM-Judge
  [ICML 2024 Oral] Official code repository for MLLM-as-a-Judge.
  ☆62Updated 2 months ago