Alternatives and similar repositories for CMMU

Users that are interested in CMMU are comparing it to the libraries listed below

• OpenMOSS / GAOKAO-MM
  [ACL'2024 Findings] GAOKAO-MM: A Chinese Human-Level Benchmark for Multimodal Models Evaluation
  ☆69Updated last year
• mayubo2333 / MMLongBench-Doc
  Official Repository of MMLONGBENCH-DOC: Benchmarking Long-context Document Understanding with Visualizations
  ☆101Updated last month
• LinWeizheDragon / FLMR
  The huggingface implementation of Fine-grained Late-interaction Multi-modal Retriever.
  ☆100Updated 5 months ago
• njucckevin / MM-Self-Improve
  A Self-Training Framework for Vision-Language Reasoning
  ☆84Updated 9 months ago
• OpenGVLab / MM-NIAH
  [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…
  ☆115Updated 11 months ago
• LengSicong / MMR1
  MMR1: Enhancing Multimodal Reasoning with Variance-Aware Sampling and Open Resources
  ☆205Updated last month
• FudanNLPLAB / MouSi
  ☆74Updated last year
• WePOINTS / WePOINTS
  ☆186Updated 8 months ago
• Kun-Xiang / AtomThink
  Offical Repository of "AtomThink: Multimodal Slow Thinking with Atomic Step Reasoning"
  ☆57Updated 3 months ago
• Liuziyu77 / MMDU
  Official repository of MMDU dataset
  ☆96Updated last year
• IMNearth / CoAT
  Official implementation for "Android in the Zoo: Chain-of-Action-Thought for GUI Agents" (Findings of EMNLP 2024)
  ☆94Updated last year
• multimodal-art-projection / P2P
  P2P: Automated Paper-to-Poster Generation and Fine-Grained Benchmark
  ☆42Updated 4 months ago
• OpenGVLab / GUI-Odyssey
  [ICCV 2025] GUIOdyssey is a comprehensive dataset for training and evaluating cross-app navigation agents. GUIOdyssey consists of 8,834 e…
  ☆130Updated 3 months ago
• RLHF-V / RLHF-V
  [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback
  ☆294Updated last year
• zai-org / CogCoM
  ☆214Updated last year
• patrick-tssn / Awesome-Colorful-LLM
  Recent advancements propelled by large language models (LLMs), encompassing an array of domains including Vision, Audio, Agent, Robotics,…
  ☆123Updated 5 months ago
• princeton-nlp / CharXiv
  [NeurIPS 2024] CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs
  ☆128Updated 6 months ago
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆109Updated 5 months ago
• EvolvingLMMs-Lab / multimodal-search-r1
  MMSearch-R1 is an end-to-end RL framework that enables LMMs to perform on-demand, multi-turn search with real-world multimodal search too…
  ☆340Updated 2 months ago
• OpenGVLab / MMT-Bench
  [ICML 2024] | MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI
  ☆114Updated last year
• CMMMU-Benchmark / CMMMU
  ☆48Updated last year
• HZQ950419 / Math-LLaVA
  Code for Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models
  ☆91Updated last year
• mathllm / MATH-V
  [NeurIPS 2024] MATH-Vision dataset and code to measure multimodal mathematical reasoning capabilities.
  ☆120Updated 5 months ago
• banksy23 / XCoder
  ☆36Updated 3 months ago
• FreedomIntelligence / ALLaVA
  Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model
  ☆275Updated last year
• We-Math / We-Math
  The code and data of We-Math, accepted by ACL 2025 main conference.
  ☆133Updated 2 weeks ago
• RLHF-V / RLAIF-V
  [CVPR'25 highlight] RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthiness
  ☆421Updated 5 months ago
• YanqiDai / MMRole
  (ICLR'25) A Comprehensive Framework for Developing and Evaluating Multimodal Role-Playing Agents
  ☆87Updated 9 months ago
• ggg0919 / cantor
  ☆91Updated last year
• OpenRLHF / OpenRLHF-M
  An Easy-to-use, Scalable and High-performance RLHF Framework designed for Multimodal Models.
  ☆147Updated 3 weeks ago