Alternatives and similar repositories for lmms-eval

Users that are interested in lmms-eval are comparing it to the libraries listed below

• OpenGVLab / V2PE
  [ArXiv] V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encoding
  ☆50Updated 6 months ago
• MileBench / MileBench
  This repo contains evaluation code for the paper "MileBench: Benchmarking MLLMs in Long Context"
  ☆35Updated 11 months ago
• vlf-silkie / VLFeedback
  ☆100Updated last year
• RUCAIBox / JiuZhang3.0
  The code and data for the paper JiuZhang3.0
  ☆47Updated last year
• SihengLi99 / TextBind
  [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation
  ☆47Updated last year
• Richar-Du / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆20Updated last month
• ShadeCloak / ADORA
  ☆46Updated 2 months ago
• ECNU-ICALK / EduChat-Math
  ☆34Updated 8 months ago
• EffiVLM-Bench / EffiVLM-Bench
  ☆16Updated 3 weeks ago
• dvlab-research / Mr-Ben
  This is the repo for our paper "Mr-Ben: A Comprehensive Meta-Reasoning Benchmark for Large Language Models"
  ☆50Updated 7 months ago
• chenllliang / G1
  G1: Bootstrapping Perception and Reasoning Abilities of Vision-Language Model via Reinforcement Learning
  ☆64Updated last month
• SkyworkAI / MindLink
  ☆46Updated this week
• NUS-TRAIL / NoisyRollout
  NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation
  ☆69Updated 3 weeks ago
• hkust-nlp / mstar
  [ICML 2025] M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning
  ☆60Updated 6 months ago
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆104Updated last month
• yhy-2000 / VideoDeepResearch
  ☆58Updated this week
• RenShuhuai-Andy / my-tools
  my commonly-used tools
  ☆56Updated 5 months ago
• MoonshotAI / Kimi-Researcher
  ☆36Updated this week
• zwq2018 / Multi-modal-Self-instruct
  The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…
  ☆79Updated 5 months ago
• namespace-Pt / UltraGist
  ☆18Updated 6 months ago
• njucckevin / MM-Self-Improve
  A Self-Training Framework for Vision-Language Reasoning
  ☆80Updated 5 months ago
• nishiwen1214 / Benchmark-leakage-detection
  Official completion of “Training on the Benchmark Is Not All You Need”.
  ☆34Updated 5 months ago
• OpenSparseLLMs / Open-Pandora
  Open-Pandora: On-the-fly Control Video Generation
  ☆34Updated 6 months ago
• haon-chen / mmE5
  ☆49Updated 4 months ago
• cs-holder / Reasoning-Self-Evolution-Survey
  ☆43Updated 3 months ago
• SUSTechBruce / LOOK-M
  [EMNLP 2024 Findings🔥] Official implementation of ": LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context In…
  ☆96Updated 7 months ago
• yyht / openrlhf_async_pipline
  ☆53Updated last week
• zhourax / VEGA
  ☆37Updated 11 months ago
• multimodal-art-projection / COIG-P
  ☆38Updated 2 months ago
• CMMMU-Benchmark / CMMMU
  ☆47Updated 9 months ago