Alternatives and similar repositories for zerobench

Users that are interested in zerobench are comparing it to the libraries listed below

• MAmmoTH-VL / MAmmoTH-VL
  (ACL 2025) MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale
  ☆49Updated 7 months ago
• yuhui-zh15 / AutoConverter
  Official implementation of "Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model Evaluation" (CVPR 202…
  ☆40Updated 7 months ago
• facebookresearch / multimodal_rewardbench
  Multimodal RewardBench
  ☆58Updated 10 months ago
• si0wang / ViCrit
  ☆24Updated 7 months ago
• yuecao0119 / MMInstruct
  [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…
  ☆62Updated last year
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆121Updated 11 months ago
• rohan598 / ConTextual
  ☆27Updated last year
• shiqichen17 / AdaptVis
  Github repository for "Why Is Spatial Reasoning Hard for VLMs? An Attention Mechanism Perspective on Focus Areas" (ICML 2025)
  ☆68Updated 8 months ago
• zeyofu / BLINK_Benchmark
  This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…
  ☆155Updated 3 months ago
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆72Updated last year
• locuslab / llava-token-compression
  ☆46Updated last year
• MengLcool / DeepStack-VL
  [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…
  ☆77Updated last year
• TencentARC / GRPO-CARE
  ☆80Updated 6 months ago
• mlfoundations / VisIT-Bench
  ☆50Updated 2 years ago
• TIGER-AI-Lab / VL-Rethinker
  The official code of "VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning" [NeurIPS25]
  ☆176Updated 7 months ago
• si0wang / VisVM
  ☆46Updated last year
• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆58Updated last year
• TIGER-AI-Lab / MEGA-Bench
  This repo contains the code for "MEGA-Bench Scaling Multimodal Evaluation to over 500 Real-World Tasks" [ICLR 2025]
  ☆77Updated 6 months ago
• WildVision-AI / LMM-Engines
  ☆17Updated last year
• mbzuai-oryx / Agent-X
  Evaluating Deep Multimodal Reasoning in Vision-Centric Agentic Tasks
  ☆34Updated last month
• declare-lab / LLM-PuzzleTest
  This repository is maintained to release dataset and models for multimodal puzzle reasoning.
  ☆113Updated 10 months ago
• amitakamath / whatsup_vlms
  Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".
  ☆68Updated last year
• RifleZhang / LLaVA-Reasoner-DPO
  ☆109Updated last year
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆62Updated last year
• wmn-231314 / diffusion-data-constraint
  Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…
  ☆118Updated last week
• YiyangZhou / CSR
  [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models
  ☆84Updated 2 months ago
• si0wang / ThinkLite-VL
  ☆105Updated 7 months ago
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆69Updated last year
• UW-Madison-Lee-Lab / CoBSAT
  Implementation and dataset for paper "Can MLLMs Perform Text-to-Image In-Context Learning?"
  ☆42Updated 7 months ago
• pliang279 / HEMM
  Holistic evaluation of multimodal foundation models
  ☆49Updated last year