Alternatives and similar repositories for PEFT-MLLM

Users that are interested in PEFT-MLLM are comparing it to the libraries listed below

• gyhdog99 / ECSO
  ECSO (Make MLLM safe without neither training nor any external models!) (https://arxiv.org/abs/2403.09572)
  ☆29Updated 9 months ago
• gyhdog99 / MoCLE
  MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)
  ☆42Updated last month
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆79Updated 8 months ago
• shengliu66 / VTI
  Code for Reducing Hallucinations in Vision-Language Models via Latent Space Steering
  ☆66Updated 8 months ago
• EchoseChen / SPA-VL-RLHF
  The reinforcement learning codes for dataset SPA-VL
  ☆36Updated last year
• LzVv123456 / VISTA
  ☆50Updated last week
• Purshow / Awesome-LVLM-Hallucination
  ☆49Updated 8 months ago
• SaFoLab-WISC / FIUBench
  A Task of Fictitious Unlearning for VLMs
  ☆19Updated 4 months ago
• Qinyu-Allen-Zhao / LVLM-LP
  The First to Know: How Token Distributions Reveal Hidden Knowledge in Large Vision-Language Models?
  ☆31Updated 9 months ago
• Sreyan88 / VDGD
  Code for ICLR 2025 Paper: Visual Description Grounding Reduces Hallucinations and Boosts Reasoning in LVLMs
  ☆17Updated 3 months ago
• UCSC-VLAA / vllm-safety-benchmark
  [ECCV 2024] Official PyTorch Implementation of "How Many Unicorns Are in This Image? A Safety Evaluation Benchmark for Vision LLMs"
  ☆81Updated last year
• TianyunYoung / Hallucination-Attribution
  This repo contains the code for the paper "Understanding and Mitigating Hallucinations in Large Vision-Language Models via Modular Attrib…
  ☆24Updated 3 weeks ago
• zjunlp / Deco
  [ICLR 2025] MLLM can see? Dynamic Correction Decoding for Hallucination Mitigation
  ☆96Updated 7 months ago
• zzz47zzz / spurious-forgetting
  [ICLR 2025] Released code for paper "Spurious Forgetting in Continual Learning of Language Models"
  ☆50Updated 3 months ago
• SaFoLab-WISC / AdaShield
  [ECCV 2024] The official code for "AdaShield: Safeguarding Multimodal Large Language Models from Structure-based Attack via Adaptive Shi…
  ☆62Updated last year
• NUS-TRAIL / NoisyRollout
  NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation
  ☆83Updated 2 months ago
• Yuqifan1117 / HalluciDoctor
  HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)
  ☆47Updated last year
• RayRuiboChen / Self-Filter
  ☆24Updated 3 weeks ago
• xirui-li / MOSSBench
  An implementation for MLLM oversensitivity evaluation
  ☆13Updated 8 months ago
• bronyayang / HallE_Control
  HallE-Control: Controlling Object Hallucination in LMMs
  ☆31Updated last year
• simplelifetime / TIVE
  Less is More: High-value Data Selection for Visual Instruction Tuning
  ☆14Updated 6 months ago
• pipilurj / MLLM-protector
  The official repository for paper "MLLM-Protector: Ensuring MLLM’s Safety without Hurting Performance"
  ☆38Updated last year
• YiyangZhou / CSR
  [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models
  ☆77Updated last year
• yfzhang114 / LLaVA-Align
  [ACM Multimedia 2025] This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual…
  ☆81Updated 5 months ago
• ChnQ / MI-Peaks
  ☆49Updated 3 weeks ago
• BillChan226 / HALC
  [ICML 2024] Official implementation for "HALC: Object Hallucination Reduction via Adaptive Focal-Contrast Decoding"
  ☆92Updated 8 months ago
• yuezih / less-is-more
  Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)
  ☆55Updated 9 months ago
• ys-zong / VLGuard
  [ICML 2024] Safety Fine-Tuning at (Almost) No Cost: A Baseline for Vision Large Language Models.
  ☆73Updated 6 months ago
• princetonvisualai / icons
  ☆19Updated 3 months ago
• Dongping-Chen / MLLM-Judge
  [ICML 2024 Oral] Official code repository for MLLM-as-a-Judge.
  ☆78Updated 5 months ago