Alternatives and similar repositories for vhs_benchmark

Users that are interested in vhs_benchmark are comparing it to the libraries listed below

• visual-haystacks / mirage
  🔥 [ICLR 2025] Official PyTorch Model "Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmark"
  ☆15Updated 5 months ago
• AtsuMiyai / UPD
  [ACL2025] Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Models
  ☆77Updated last month
• Wang-ML-Lab / multimodal-needle-in-a-haystack
  [NAACL 2025 Oral] Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Language Models
  ☆47Updated 2 months ago
• zeyofu / BLINK_Benchmark
  This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…
  ☆130Updated last year
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆68Updated last year
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆57Updated 8 months ago
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆65Updated last year
• EvolvingLMMs-Lab / multimodal-sae
  [ICCV 2025] Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.
  ☆144Updated this week
• TIGER-AI-Lab / MEGA-Bench
  This repo contains the code for "MEGA-Bench Scaling Multimodal Evaluation to over 500 Real-World Tasks" [ICLR2025]
  ☆71Updated 2 weeks ago
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆143Updated 8 months ago
• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆46Updated 8 months ago
• zeyofu / ReFocus_Code
  Codes for ReFocus: Visual Editing as a Chain of Thought for Structured Image Understanding [ICML 2025]]
  ☆35Updated last week
• gzcch / Bingo
  ☆55Updated last year
• shulin16 / MMInA
  Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"
  ☆46Updated 4 months ago
• UW-Madison-Lee-Lab / CoBSAT
  Implementation and dataset for paper "Can MLLMs Perform Text-to-Image In-Context Learning?"
  ☆39Updated last month
• JieyuZ2 / TaskMeAnything
  [NeurIPS 2024] A task generation and model evaluation system for multimodal language models.
  ☆71Updated 7 months ago
• mlfoundations / VisIT-Bench
  ☆50Updated last year
• pliang279 / HEMM
  Holistic evaluation of multimodal foundation models
  ☆48Updated 11 months ago
• luka-group / vlm-knowledge-conflict
  Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."
  ☆42Updated 8 months ago
• MAmmoTH-VL / MAmmoTH-VL
  (ACL 2025) MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale
  ☆46Updated last month
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆111Updated 5 months ago
• cliangyu / Cola
  [NeurIPS2023] Official implementation of the paper "Large Language Models are Visual Reasoning Coordinators"
  ☆105Updated last year
• RifleZhang / LLaVA-Reasoner-DPO
  ☆83Updated 6 months ago
• jonathan-roberts1 / zerobench
  Code, Data and Red Teaming for ZeroBench
  ☆46Updated 2 months ago
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆86Updated last year
• yunfeixie233 / ViGaL
  ☆48Updated last month
• si0wang / VisVM
  ☆45Updated 6 months ago
• ByungKwanLee / Phantom
  [Under Review] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with enla…
  ☆60Updated 9 months ago
• bigai-nlco / LatentSeek
  Official Repository of LatentSeek
  ☆51Updated last month
• shiqichen17 / VLM_Merging
  Github repository for "Bring Reason to Vision: Understanding Perception and Reasoning through Model Merging" (ICML 2025)
  ☆63Updated last month