Alternatives and similar repositories for MMEvalPro:

Users that are interested in MMEvalPro are comparing it to the libraries listed below

• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆53Updated 5 months ago
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆47Updated 3 months ago
• dvlab-research / Mr-Ben
  This is the repo for our paper "Mr-Ben: A Comprehensive Meta-Reasoning Benchmark for Large Language Models"
  ☆47Updated 5 months ago
• TIGER-AI-Lab / VisualWebInstruct
  The official repo for "VisualWebInstruct: Scaling up Multimodal Instruction Data through Web Search"
  ☆24Updated 3 weeks ago
• KbsdJames / omni-math-rule
  The rule-based evaluation subset and code implementation of Omni-MATH
  ☆18Updated 3 months ago
• shulin16 / MMInA
  Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"
  ☆42Updated last month
• RUCAIBox / JiuZhang3.0
  The code and data for the paper JiuZhang3.0
  ☆43Updated 10 months ago
• OpenGVLab / V2PE
  [ArXiv] V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encoding
  ☆37Updated 4 months ago
• mlfoundations / VisIT-Bench
  ☆49Updated last year
• GAIR-NLP / weak-to-strong-reasoning
  ☆59Updated 7 months ago
• Yifan-Song793 / GoodBadGreedy
  The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism
  ☆28Updated 8 months ago
• open-compass / CriticEval
  [NeurIPS 2024] A comprehensive benchmark for evaluating critique ability of LLMs
  ☆39Updated 4 months ago
• MileBench / MileBench
  This repo contains evaluation code for the paper "MileBench: Benchmarking MLLMs in Long Context"
  ☆31Updated 9 months ago
• kkk-an / COFFTEA
  Code for Findings of EMNLP2023 paper "Coarse-to-Fine Dual Encoders are Better Frame Identification Learners"
  ☆12Updated last year
• apple / ml-mia-bench
  This repo contains code and data for ICLR 2025 paper MIA-Bench: Towards Better Instruction Following Evaluation of Multimodal LLMs
  ☆26Updated last month
• yale-nlp / refdpo
  ☆16Updated 8 months ago
• zwq2018 / Multi-modal-Self-instruct
  The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…
  ☆76Updated 2 months ago
• DAMO-NLP-SG / LongPO
  [ICLR 2025] LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization
  ☆31Updated last month
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆34Updated 6 months ago
• GAIR-NLP / OlympicArena
  [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI
  ☆99Updated last month
• HKUNLP / critic-rl
  Code for Paper: Teaching Language Models to Critique via Reinforcement Learning
  ☆90Updated this week
• EvolvingLMMs-Lab / multimodal-search-r1
  ☆78Updated last week
• hkust-nlp / mstar
  M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning
  ☆56Updated 3 months ago
• jinzhuoran / RAG-RewardBench
  RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment
  ☆16Updated 3 months ago
• Yangyi-Chen / CoTConsistency
  The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".
  ☆32Updated last year
• Shwai-He / MEO
  The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":
  ☆36Updated last year
• dvlab-research / Q-LLM
  This is the official repo of "QuickLLaMA: Query-aware Inference Acceleration for Large Language Models"
  ☆47Updated 8 months ago
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆47Updated last year
• SparksJoe / Prism
  A Framework for Decoupling and Assessing the Capabilities of VLMs
  ☆41Updated 9 months ago
• bethgelab / sober-reasoning
  ☆16Updated this week