Alternatives and similar repositories for MageBench

Users that are interested in MageBench are comparing it to the libraries listed below

• ASTRAL-Group / AlphaOne
  [EMNLP 2025 Main] AlphaOne: Reasoning Models Thinking Slow and Fast at Test Time
  ☆88Updated 6 months ago
• yihedeng9 / OpenVLThinker
  OpenVLThinker: An Early Exploration to Vision-Language Reasoning via Iterative Self-Improvement
  ☆126Updated 5 months ago
• JieyuZ2 / TaskMeAnything
  [NeurIPS 2024] A task generation and model evaluation system for multimodal language models.
  ☆73Updated last year
• SalesforceAIResearch / LATTE
  ☆68Updated 3 months ago
• InfiXAI / InfiGUIAgent
  ☆73Updated 7 months ago
• Gabesarch / ICAL
  ☆51Updated 7 months ago
• microsoft / x-reasoner
  X-Reasoner: Towards Generalizable Reasoning Across Modalities and Domains
  ☆50Updated 8 months ago
• yunfeixie233 / ViGaL
  ☆64Updated 2 months ago
• Yan98 / GTA1
  ☆121Updated 3 months ago
• xufangzhi / Genius
  [ACL 2025] A Generalizable and Purely Unsupervised Self-Training Framework
  ☆71Updated 7 months ago
• dvlab-research / ARPO
  Official Implementation of ARPO: End-to-End Policy Optimization for GUI Agents with Experience Replay
  ☆140Updated 7 months ago
• RifleZhang / LLaVA-Reasoner-DPO
  ☆109Updated last year
• mbzuai-oryx / Agent-X
  Evaluating Deep Multimodal Reasoning in Vision-Centric Agentic Tasks
  ☆33Updated last month
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆109Updated 7 months ago
• chengyou-jia / AgentStore
  [ACL 2025] AgentStore: Scalable Integration of Heterogeneous Agents As Specialized Generalist Computer Assistant
  ☆42Updated last year
• Wang-ML-Lab / multimodal-needle-in-a-haystack
  [NAACL 2025 Oral] Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Language Models
  ☆54Updated 8 months ago
• JiuTian-VL / Optimus-1
  [NeurIPS 2024] Official Implementation for Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Tasks
  ☆91Updated 6 months ago
• TIGER-AI-Lab / VL-Rethinker
  The official code of "VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning" [NeurIPS25]
  ☆174Updated 7 months ago
• yannqi / R-4B
  The official repository of "R-4B: Incentivizing General-Purpose Auto-Thinking Capability in MLLMs via Bi-Mode Integration"
  ☆131Updated 4 months ago
• callsys / GMPO
  Geometric-Mean Policy Optimization
  ☆96Updated last month
• xlang-ai / OSWorld-G
  [NeurIPS 2025 Spotlight] Scaling Computer-Use Grounding via UI Decomposition and Synthesis
  ☆138Updated 2 months ago
• kokolerk / TON
  [NeurIPS 2025] Think or Not? Selective Reasoning via Reinforcement Learning for Vision-Language Models
  ☆52Updated 3 months ago
• XinrunXu / DeepPHY
  DeepPHY: Benchmarking Agentic VLMs on Physical Reasoning
  ☆167Updated last month
• OpenGVLab / ZeroGUI
  ZeroGUI: Automating Online GUI Learning at Zero Human Cost
  ☆104Updated 5 months ago
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆62Updated last year
• gyhdog99 / RACRO2
  Official PyTorch implementation of RACRO (https://www.arxiv.org/abs/2506.04559)
  ☆19Updated 6 months ago
• shulin16 / MMInA
  [ACL2025 Findings] Benchmarking Multihop Multimodal Internet Agents
  ☆47Updated 10 months ago
• TIGER-AI-Lab / Hierarchical-Reasoner
  Emergent Hierarchical Reasoning in LLMs/VLMs through Reinforcement Learning
  ☆55Updated 2 months ago
• metal-chart-generation / metal
  ☆41Updated 7 months ago
• Open-Reasoner-Zero / Open-Vision-Reasoner
  [NeurIPS 2025] The official repository for our paper, "Open Vision Reasoner: Transferring Linguistic Cognitive Behavior for Visual Reason…
  ☆152Updated 3 months ago