Alternatives and similar repositories for MMIU

Users that are interested in MMIU are comparing it to the libraries listed below

• Liuziyu77 / MIA-DPO
  Official implement of MIA-DPO
  ☆62Updated 6 months ago
• Dongping-Chen / ISG
  (ICLR 2025 Spotlight) Official code repository for Interleaved Scene Graph.
  ☆27Updated 6 months ago
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆144Updated 8 months ago
• yuecao0119 / MMInstruct
  [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…
  ☆55Updated 8 months ago
• TencentARC / GRPO-CARE
  ☆66Updated last month
• Beckschen / LLaVolta
  [NeurIPS 2024] Efficient Large Multi-modal Models via Visual Context Compression
  ☆60Updated 5 months ago
• Yxxxb / VoCo-LLaMA
  [CVPR'2025] VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".
  ☆176Updated last month
• TencentARC / SEED-Bench-R1
  ☆87Updated last month
• zwq2018 / Multi-modal-Self-instruct
  The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…
  ☆82Updated 6 months ago
• foundation-multimodal-models / CAPTURE
  ☆66Updated last year
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆48Updated 4 months ago
• Liuziyu77 / MMDU
  Official repository of MMDU dataset
  ☆92Updated 10 months ago
• bronyayang / Law_of_Vision_Representation_in_MLLMs
  Official implementation of the Law of Vision Representation in MLLMs
  ☆163Updated 8 months ago
• imagegridworth / IG-VLM
  ☆138Updated 10 months ago
• TencentARC / Video-Holmes
  Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?
  ☆62Updated 3 weeks ago
• Mr-Loevan / FAST
  Fast-Slow Thinking for Large Vision-Language Model Reasoning
  ☆16Updated 3 months ago
• sterzhang / PVIT
  Official Repository of Personalized Visual Instruct Tuning
  ☆32Updated 4 months ago
• MME-Benchmarks / MME-Unify
  MME-Unify: A Comprehensive Benchmark for Unified Multimodal Understanding and Generation Models
  ☆41Updated 3 months ago
• si0wang / VisVM
  ☆45Updated 7 months ago
• rese1f / aurora
  [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark
  ☆119Updated 2 months ago
• pipilurj / bootstrapped-preference-optimization-BPO
  code for "Strengthening Multimodal Large Language Model with Bootstrapped Preference Optimization"
  ☆57Updated 11 months ago
• foundation-multimodal-models / CAL
  [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment
  ☆58Updated 10 months ago
• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆36Updated 4 months ago
• NUS-TRAIL / NoisyRollout
  NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation
  ☆80Updated last month
• UW-Madison-Lee-Lab / CoBSAT
  Implementation and dataset for paper "Can MLLMs Perform Text-to-Image In-Context Learning?"
  ☆40Updated 2 months ago
• CSU-JPG / TextAtlas
  A Large-scale Dataset for training and evaluating model's ability on Dense Text Image Generation
  ☆70Updated 5 months ago
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆95Updated last year
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated 2 years ago
• findalexli / mllm-dpo
  [ACL 2024] Multi-modal preference alignment remedies regression of visual instruction tuning on language model
  ☆46Updated 8 months ago
• showlab / MovieSeq
  [ECCV 2024] Learning Video Context as Interleaved Multimodal Sequences
  ☆40Updated 4 months ago