Alternatives and similar repositories for PEFT-MLLM:

Users that are interested in PEFT-MLLM are comparing it to the libraries listed below

• EchoseChen / SPA-VL-RLHF
  The reinforcement learning codes for dataset SPA-VL
  ☆31Updated 8 months ago
• swj0419 / muse_bench
  ☆20Updated 7 months ago
• HillZhang1999 / ICD
  Code & Data for our Paper "Alleviating Hallucinations of Large Language Models through Induced Hallucinations"
  ☆63Updated last year
• gyhdog99 / MoCLE
  MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)
  ☆34Updated 11 months ago
• jinzhuoran / RWKU
  RWKU: Benchmarking Real-World Knowledge Unlearning for Large Language Models. NeurIPS 2024
  ☆69Updated 5 months ago
• gyhdog99 / ECSO
  ECSO (Make MLLM safe without neither training nor any external models!) (https://arxiv.org/abs/2403.09572)
  ☆22Updated 4 months ago
• UCSC-VLAA / vllm-safety-benchmark
  [ECCV 2024] Official PyTorch Implementation of "How Many Unicorns Are in This Image? A Safety Evaluation Benchmark for Vision LLMs"
  ☆77Updated last year
• circle-hit / SAPT
  Code for ACL 2024 accepted paper titled "SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language …
  ☆32Updated 2 months ago
• Jihuai-wpy / InferAligner
  ☆30Updated 5 months ago
• SihengLi99 / LLM-Honesty-Survey
  A Survey on the Honesty of Large Language Models
  ☆54Updated 3 months ago
• hkust-nlp / PEM_composition
  [NeurIPS 2023] Github repository for "Composing Parameter-Efficient Modules with Arithmetic Operations"
  ☆60Updated last year
• licong-lin / negative-preference-optimization
  ☆49Updated 7 months ago
• deeplearning-wisc / picle
  Official code for ICML 2024 paper on Persona In-Context Learning (PICLe)
  ☆23Updated 8 months ago
• OPTML-Group / SOUL
  Official repo for EMNLP'24 paper "SOUL: Unlocking the Power of Second-Order Optimization for LLM Unlearning"
  ☆19Updated 5 months ago
• VT-NLP / MixLoRA
  Multimodal Instruction Tuning with Conditional Mixture of LoRA (ACL 2024)
  ☆14Updated 7 months ago
• keven980716 / weak-to-strong-deception
  [ICLR 2025] Code&Data for the paper "Super(ficial)-alignment: Strong Models May Deceive Weak Models in Weak-to-Strong Generalization"
  ☆13Updated 8 months ago
• pkunlp-icler / IKE
  ☆24Updated 2 years ago
• ys-zong / VLGuard
  [ICML 2024] Safety Fine-Tuning at (Almost) No Cost: A Baseline for Vision Large Language Models.
  ☆57Updated last month
• hkust-nlp / mstar
  M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning
  ☆55Updated 2 months ago
• thunxxx / MLLM-Jailbreak-evaluation-MMJ-Bench
  ☆31Updated 3 months ago
• princeton-nlp / benign-data-breaks-safety
  ☆30Updated 5 months ago
• Qinyu-Allen-Zhao / LVLM-LP
  The First to Know: How Token Distributions Reveal Hidden Knowledge in Large Vision-Language Models?
  ☆26Updated 4 months ago
• AI45Lab / MLLMGuard
  ☆23Updated 4 months ago
• RainBowLuoCS / DEEM
  (ICLR2025 Spotlight) DEEM: Official implementation of Diffusion models serve as the eyes of large language models for image perception.
  ☆23Updated this week
• SophieZheng998 / ALI-Agent
  Official implementation for "ALI-Agent: Assessing LLMs'Alignment with Human Values via Agent-based Evaluation"
  ☆15Updated last month
• luka-group / vlm-knowledge-conflict
  Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."
  ☆41Updated 4 months ago
• git-disl / Vaccine
  This is the official code for the paper "Vaccine: Perturbation-aware Alignment for Large Language Models" (NeurIPS2024)
  ☆40Updated 3 months ago