Alternatives and similar repositories for LMM-Engines:

Users that are interested in LMM-Engines are comparing it to the libraries listed below

• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆53Updated 5 months ago
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆65Updated 10 months ago
• shulin16 / MMInA
  Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"
  ☆42Updated last month
• luka-group / vlm-knowledge-conflict
  Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."
  ☆42Updated 5 months ago
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆59Updated 9 months ago
• OpenGVLab / V2PE
  [ArXiv] V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encoding
  ☆37Updated 4 months ago
• rohan598 / ConTextual
  ☆25Updated 8 months ago
• mlfoundations / VisIT-Bench
  ☆49Updated last year
• facebookresearch / multimodal_rewardbench
  Multimodal RewardBench
  ☆38Updated last month
• WildVision-AI / WildVision-Bench
  ☆16Updated 5 months ago
• EvolvingLMMs-Lab / multimodal-search-r1
  ☆78Updated last week
• muirbench / MuirBench
  A Comprehensive Benchmark for Robust Multi-image Understanding
  ☆10Updated 7 months ago
• chenllliang / MMEvalPro
  [NAACL 2025] Source code for MMEvalPro, a more trustworthy and efficient benchmark for evaluating LMMs
  ☆23Updated 6 months ago
• princeton-nlp / PTP
  Improving Language Understanding from Screenshots. Paper: https://arxiv.org/abs/2402.14073
  ☆28Updated 9 months ago
• core-mm / core-mm
  ☆17Updated last year
• si0wang / VisVM
  ☆38Updated 3 months ago
• AtsuMiyai / UPD
  Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models
  ☆75Updated 6 months ago
• Yangyi-Chen / CoTConsistency
  The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".
  ☆32Updated last year
• zeyofu / ReFocus_Code
  Codes for ReFocus: Visual Editing as a Chain of Thought for Structured Image Understanding
  ☆22Updated 3 months ago
• TencentARC / SEED-Bench-R1
  ☆66Updated last week
• yale-nlp / TOMATO
  ☆24Updated 5 months ago
• mshukor / ima-lmms
  [NeurIPS2024] Official code for (IMA) Implicit Multimodal Alignment: On the Generalization of Frozen LLMs to Multimodal Inputs
  ☆18Updated 6 months ago
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆82Updated 11 months ago
• Hxyou / IdealGPT
  Official Code of IdealGPT
  ☆34Updated last year
• showlab / VisInContext
  Official implementation of Leveraging Visual Tokens for Extended Text Contexts in Multi-Modal Learning
  ☆15Updated 5 months ago
• vlf-silkie / VLFeedback
  ☆96Updated last year
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆46Updated last month
• dvlab-research / Mr-Ben
  This is the repo for our paper "Mr-Ben: A Comprehensive Meta-Reasoning Benchmark for Large Language Models"
  ☆47Updated 5 months ago
• MJ-Bench / MJ-Bench
  Official implementation for "MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?"
  ☆43Updated last month
• TIGER-AI-Lab / VISTA
  The code for "VISTA: Enhancing Long-Duration and High-Resolution Video Understanding by VIdeo SpatioTemporal Augmentation" [CVPR2025]
  ☆15Updated last month