Alternatives and similar repositories for MageBench

Users that are interested in MageBench are comparing it to the libraries listed below

• yihedeng9 / OpenVLThinker
  OpenVLThinker: An Early Exploration to Vision-Language Reasoning via Iterative Self-Improvement
  ☆83Updated this week
• NuoJohnChen / JudgeLRM
  ☆24Updated 3 weeks ago
• showlab / VideoGUI
  [NeurIPS 2024 D&B] VideoGUI: A Benchmark for GUI Automation from Instructional Videos
  ☆35Updated last month
• SalesforceAIResearch / TACO
  ☆55Updated 2 months ago
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆65Updated 11 months ago
• EvolvingLMMs-Lab / VideoMMMU
  ☆43Updated last month
• JieyuZ2 / TaskMeAnything
  [NeurIPS 2024] A task generation and model evaluation system for multimodal language models.
  ☆70Updated 5 months ago
• dinobby / Symbolic-MoE
  The code implementation of Symbolic-MoE
  ☆31Updated 2 months ago
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆62Updated 10 months ago
• Gabesarch / ICAL
  ☆38Updated 2 months ago
• showlab / VisInContext
  Official implementation of Leveraging Visual Tokens for Extended Text Contexts in Multi-Modal Learning
  ☆15Updated 6 months ago
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆56Updated 6 months ago
• chengyou-jia / AgentStore
  ☆38Updated 4 months ago
• siyuyuan / evoagent
  Resources for our paper: "EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms"
  ☆96Updated 6 months ago
• shulin16 / MMInA
  Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"
  ☆43Updated 2 months ago
• EvolvingLMMs-Lab / multimodal-search-r1
  ☆95Updated last month
• microsoft / x-reasoner
  X-Reasoner: Towards Generalizable Reasoning Across Modalities and Domains
  ☆30Updated this week
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆100Updated 2 months ago
• neulab / MultiUI
  Code for Paper: Harnessing Webpage Uis For Text Rich Visual Understanding
  ☆51Updated 5 months ago
• TIGER-AI-Lab / VL-Rethinker
  The official code of "VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning"
  ☆90Updated last week
• TIGER-AI-Lab / MEGA-Bench
  This repo contains the code for "MEGA-Bench Scaling Multimodal Evaluation to over 500 Real-World Tasks" [ICLR2025]
  ☆65Updated 3 weeks ago
• EternityYW / Gemini-Commonsense-Evaluation
  Official implementation of "Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models"
  ☆36Updated last year
• John-AI-Lab / NoisyRollout
  NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation
  ☆53Updated last week
• SHI-Labs / OLA-VLM
  OLA-VLM: Elevating Visual Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024
  ☆59Updated 2 months ago
• yuhui-zh15 / AutoConverter
  Official implementation of "Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model Evaluation" (CVPR 202…
  ☆25Updated last month
• TencentARC / Plot2Code
  ☆19Updated 8 months ago
• LAMDASZ-ML / Self-Backtracking
  ☆46Updated 3 months ago
• njucckevin / MM-Self-Improve
  A Self-Training Framework for Vision-Language Reasoning
  ☆77Updated 3 months ago
• om-ai-lab / ZoomEye
  ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Exploration
  ☆34Updated 4 months ago
• cyzus / thoughtsculpt
  ☆13Updated 5 months ago