Alternatives and similar repositories for vhs_benchmark

Users that are interested in vhs_benchmark are comparing it to the libraries listed below

• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆90Updated last year
• zeyofu / BLINK_Benchmark
  This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…
  ☆159Updated 4 months ago
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆69Updated last year
• mshukor / ima-lmms
  [NeurIPS2024] Official code for (IMA) Implicit Multimodal Alignment: On the Generalization of Frozen LLMs to Multimodal Inputs
  ☆23Updated last year
• vlf-silkie / VLFeedback
  ☆101Updated 2 years ago
• yuhui-zh15 / C3
  Official implementation of "Connect, Collapse, Corrupt: Learning Cross-Modal Tasks with Uni-Modal Data" (ICLR 2024)
  ☆34Updated last year
• yuhui-zh15 / AutoConverter
  Official implementation of "Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model Evaluation" (CVPR 202…
  ☆40Updated 8 months ago
• shiqichen17 / VLM_Merging
  Github repository for "Bring Reason to Vision: Understanding Perception and Reasoning through Model Merging" (ICML 2025)
  ☆88Updated 4 months ago
• bronyayang / Law_of_Vision_Representation_in_MLLMs
  [COLM'25] Official implementation of the Law of Vision Representation in MLLMs
  ☆176Updated 4 months ago
• Dongping-Chen / MLLM-Judge
  [ICML 2024 Oral] Official code repository for MLLM-as-a-Judge.
  ☆89Updated 11 months ago
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆85Updated last year
• pipilurj / bootstrapped-preference-optimization-BPO
  code for "Strengthening Multimodal Large Language Model with Bootstrapped Preference Optimization"
  ☆60Updated last year
• zeyofu / ReFocus_Code
  Codes for ReFocus: Visual Editing as a Chain of Thought for Structured Image Understanding [ICML 2025]]
  ☆45Updated 6 months ago
• YiyangZhou / CSR
  [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models
  ☆84Updated 3 months ago
• mu-cai / TemporalBench
  TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Models
  ☆37Updated last year
• RifleZhang / LLaVA-Hound-DPO
  ☆155Updated last year
• opendatalab / HA-DPO
  Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimization
  ☆100Updated 2 years ago
• zwq2018 / Multi-modal-Self-instruct
  The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…
  ☆86Updated last year
• luka-group / vlm-knowledge-conflict
  Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."
  ☆52Updated last year
• RAIVNLab / sugar-crepe
  [NeurIPS 2023] A faithful benchmark for vision-language compositionality
  ☆89Updated last year
• longvideobench / LongVideoBench
  [Neurips 24' D&B] Official Dataloader and Evaluation Scripts for LongVideoBench.
  ☆113Updated last year
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated 2 years ago
• visual-haystacks / mirage
  🔥 [ICLR 2025] Official PyTorch Model "Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmark"
  ☆26Updated last year
• mlfoundations / VisIT-Bench
  ☆50Updated 2 years ago
• RifleZhang / LLaVA-Reasoner-DPO
  ☆110Updated last year
• nickjiang2378 / vlm-hallucinations
  [ICLR '25] Official Pytorch implementation of "Interpreting and Editing Vision-Language Representations to Mitigate Hallucinations"
  ☆95Updated 2 months ago
• OpenGVLab / MMT-Bench
  [ICML 2024] | MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI
  ☆116Updated last year
• EvolvingLMMs-Lab / multimodal-sae
  [ICCV 2025] Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.
  ☆179Updated 4 months ago
• amitakamath / whatsup_vlms
  Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".
  ☆70Updated last year
• MAmmoTH-VL / MAmmoTH-VL
  (ACL 2025) MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale
  ☆49Updated 8 months ago