Alternatives and similar repositories for MMCBench:

Users that are interested in MMCBench are comparing it to the libraries listed below

• UCSC-VLAA / vllm-safety-benchmark
  [ECCV 2024] Official PyTorch Implementation of "How Many Unicorns Are in This Image? A Safety Evaluation Benchmark for Vision LLMs"
  ☆77Updated last year
• zjunlp / Deco
  [ICLR 2025] MLLM can see? Dynamic Correction Decoding for Hallucination Mitigation
  ☆40Updated 3 months ago
• Dongping-Chen / MLLM-Judge
  [ICML 2024 Oral] Official code repository for MLLM-as-a-Judge.
  ☆64Updated 3 weeks ago
• RainBowLuoCS / DEEM
  (ICLR2025 Spotlight) DEEM: Official implementation of Diffusion models serve as the eyes of large language models for image perception.
  ☆23Updated this week
• pipilurj / MLLM-protector
  The official repository for paper "MLLM-Protector: Ensuring MLLM’s Safety without Hurting Performance"
  ☆34Updated 10 months ago
• AtsuMiyai / UPD
  Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models
  ☆74Updated 5 months ago
• sail-sg / AnyDoor
  AnyDoor: Test-Time Backdoor Attacks on Multimodal Large Language Models
  ☆50Updated 11 months ago
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆50Updated 4 months ago
• clemneo / llava-interp
  ☆41Updated 4 months ago
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated last year
• Yuqifan1117 / HalluciDoctor
  HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)
  ☆44Updated 7 months ago
• sterzhang / PVIT
  Official Repository of Personalized Visual Instruct Tuning
  ☆27Updated last week
• MJ-Bench / MJ-Bench
  Official implementation for "MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?"
  ☆44Updated 2 weeks ago
• gyhdog99 / ECSO
  ECSO (Make MLLM safe without neither training nor any external models!) (https://arxiv.org/abs/2403.09572)
  ☆22Updated 4 months ago
• shulin16 / MMInA
  Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"
  ☆41Updated 2 weeks ago
• ys-zong / VLGuard
  [ICML 2024] Safety Fine-Tuning at (Almost) No Cost: A Baseline for Vision Large Language Models.
  ☆57Updated last month
• Yangyi-Chen / CoTConsistency
  The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".
  ☆32Updated last year
• YiyangZhou / CSR
  [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models
  ☆68Updated 9 months ago
• gzcch / Bingo
  ☆54Updated 11 months ago
• Qinyu-Allen-Zhao / LVLM-LP
  The First to Know: How Token Distributions Reveal Hidden Knowledge in Large Vision-Language Models?
  ☆26Updated 4 months ago
• locuslab / llava-token-compression
  ☆39Updated 4 months ago
• AoiDragon / HADES
  [ECCV'24 Oral] The official GitHub page for ''Images are Achilles' Heel of Alignment: Exploiting Visual Vulnerabilities for Jailbreaking …
  ☆24Updated 4 months ago
• d-ailin / CLIP-Guided-Decoding
  ☆16Updated 7 months ago
• yfzhang114 / LLaVA-Align
  This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strat…
  ☆75Updated 2 weeks ago
• AoiDragon / POPE
  [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''
  ☆79Updated 11 months ago
• UCSC-VLAA / AttnGCG-attack
  ☆14Updated 5 months ago
• thu-coai / SafeUnlearning
  Safe Unlearning: A Surprisingly Effective and Generalizable Solution to Defend Against Jailbreak Attacks
  ☆24Updated 8 months ago
• jaehong31 / SAFREE
  [ICLR 2025] SAFREE: Training-Free and Adaptive Guard for Safe Text-to-Image and Video Generation
  ☆29Updated last month
• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆27Updated 8 months ago