Alternatives and similar repositories for MMIU

Users that are interested in MMIU are comparing it to the libraries listed below

• Liuziyu77 / MIA-DPO
  Official implement of MIA-DPO
  ☆64Updated 7 months ago
• Dongping-Chen / ISG
  (ICLR 2025 Spotlight) Official code repository for Interleaved Scene Graph.
  ☆27Updated 2 weeks ago
• TencentARC / GRPO-CARE
  ☆70Updated 2 months ago
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆146Updated 9 months ago
• zwq2018 / Multi-modal-Self-instruct
  The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…
  ☆83Updated 6 months ago
• Yxxxb / VoCo-LLaMA
  [CVPR'2025] VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".
  ☆184Updated 2 months ago
• foundation-multimodal-models / CAPTURE
  ☆69Updated last year
• si0wang / VisVM
  ☆45Updated 7 months ago
• yuecao0119 / MMInstruct
  [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…
  ☆55Updated 9 months ago
• GAIR-NLP / thinking-with-generated-images
  Doodling our way to AGI ✏️ 🖼️ 🧠
  ☆89Updated 2 months ago
• Haochen-Wang409 / TreeVGR
  Official implementation of "Traceable Evidence Enhanced Visual Grounded Reasoning: Evaluation and Methodology"
  ☆50Updated last month
• NUS-TRAIL / NoisyRollout
  NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation
  ☆85Updated last week
• foundation-multimodal-models / CAL
  [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment
  ☆57Updated 10 months ago
• MME-Benchmarks / MME-Unify
  MME-Unify: A Comprehensive Benchmark for Unified Multimodal Understanding and Generation Models
  ☆42Updated 4 months ago
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆47Updated 5 months ago
• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆48Updated 9 months ago
• TIGER-AI-Lab / VL-Rethinker
  The official code of "VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning"
  ☆139Updated 2 months ago
• rese1f / aurora
  [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark
  ☆122Updated 2 months ago
• Liuziyu77 / MMDU
  Official repository of MMDU dataset
  ☆93Updated 10 months ago
• dvlab-research / Prompt-Highlighter
  [CVPR 2024] Prompt Highlighter: Interactive Control for Multi-Modal LLMs
  ☆151Updated last year
• TencentARC / SEED-Bench-R1
  ☆87Updated 2 months ago
• MME-Benchmarks / MME-CoT
  MME-CoT: Benchmarking Chain-of-Thought in LMMs for Reasoning Quality, Robustness, and Efficiency
  ☆126Updated 2 weeks ago
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆95Updated last year
• Beckschen / LLaVolta
  [NeurIPS 2024] Efficient Large Multi-modal Models via Visual Context Compression
  ☆62Updated 6 months ago
• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆36Updated 4 months ago
• UW-Madison-Lee-Lab / CoBSAT
  Implementation and dataset for paper "Can MLLMs Perform Text-to-Image In-Context Learning?"
  ☆41Updated 2 months ago
• YiyangZhou / CSR
  [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models
  ☆79Updated last year
• TencentARC / Video-Holmes
  Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?
  ☆66Updated last month
• Mr-Loevan / FAST
  Fast-Slow Thinking for Large Vision-Language Model Reasoning
  ☆17Updated 3 months ago
• sterzhang / PVIT
  Official Repository of Personalized Visual Instruct Tuning
  ☆32Updated 5 months ago