Alternatives and similar repositories for IV-Bench:

Users that are interested in IV-Bench are comparing it to the libraries listed below

• TIGER-AI-Lab / VISTA
  The code for "VISTA: Enhancing Long-Duration and High-Resolution Video Understanding by VIdeo SpatioTemporal Augmentation" [CVPR2025]
  ☆15Updated 2 months ago
• facebookresearch / multimodal_rewardbench
  Multimodal RewardBench
  ☆38Updated 2 months ago
• SihengLi99 / TextBind
  [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation
  ☆47Updated last year
• DreamMr / RAP
  Code for Retrieval-Augmented Perception (RAP)
  ☆10Updated 2 months ago
• Share14 / ShareGemini
  ☆30Updated 9 months ago
• MAmmoTH-VL / MAmmoTH-VL
  MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale
  ☆41Updated 4 months ago
• Vinoground / Vinoground
  ☆10Updated 6 months ago
• HYPJUDY / Sparkles
  Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models
  ☆44Updated 10 months ago
• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆44Updated 5 months ago
• muirbench / MuirBench
  A Comprehensive Benchmark for Robust Multi-image Understanding
  ☆10Updated 8 months ago
• RUCAIBox / Event-Bench
  Official code of *Towards Event-oriented Long Video Understanding*
  ☆12Updated 9 months ago
• Yangyi-Chen / CoTConsistency
  The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".
  ☆32Updated last year
• shizhediao / DaVinci
  Source code for the paper "Prefix Language Models are Unified Modal Learners"
  ☆43Updated 2 years ago
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆47Updated last month
• psunlpgroup / VisOnlyQA
  This repository contains the code and data for the paper "VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception o…
  ☆22Updated last month
• eric-ai-lab / MMWorld
  Official repo of the ICLR 2025 paper "MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos"
  ☆25Updated 7 months ago
• si0wang / VisVM
  ☆40Updated 4 months ago
• bcdnlp / FAITHSCORE
  ☆28Updated last month
• zeyofu / ReFocus_Code
  Codes for ReFocus: Visual Editing as a Chain of Thought for Structured Image Understanding
  ☆24Updated this week
• mlfoundations / VisIT-Bench
  ☆51Updated last year
• lscpku / VITATECS
  ☆18Updated 9 months ago
• apple / ml-mia-bench
  This repo contains code and data for ICLR 2025 paper MIA-Bench: Towards Better Instruction Following Evaluation of Multimodal LLMs
  ☆31Updated last month
• e-bug / fine-grained-evals
  [ACL 2023] Code and data for our paper "Measuring Progress in Fine-grained Vision-and-Language Understanding"
  ☆13Updated last year
• TIGER-AI-Lab / MEGA-Bench
  This repo contains the code for "MEGA-Bench Scaling Multimodal Evaluation to over 500 Real-World Tasks" [ICLR2025]
  ☆65Updated 2 weeks ago
• vlf-silkie / VLFeedback
  ☆99Updated last year
• mshukor / ima-lmms
  [NeurIPS2024] Official code for (IMA) Implicit Multimodal Alignment: On the Generalization of Frozen LLMs to Multimodal Inputs
  ☆18Updated 6 months ago
• ajd12342 / why-winoground-hard
  Code for 'Why is Winoground Hard? Investigating Failures in Visuolinguistic Compositionality', EMNLP 2022
  ☆30Updated last year
• John-AI-Lab / NoisyRollout
  NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation
  ☆53Updated last week
• HanSolo9682 / CounterCurate
  This is the implementation of CounterCurate, the data curation pipeline of both physical and semantic counterfactual image-caption pairs.
  ☆18Updated 10 months ago
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆55Updated 6 months ago