Alternatives and similar repositories for MLLM-Tool

Users that are interested in MLLM-Tool are comparing it to the libraries listed below

• Haochen-Wang409 / ross
  [ICLR'25] Reconstructive Visual Instruction Tuning
  ☆132Updated 8 months ago
• z-x-yang / DoraemonGPT
  Official repository of DoraemonGPT: Toward Understanding Dynamic Scenes with Large Language Models
  ☆88Updated last year
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆76Updated last year
• rongyaofang / PUMA
  Empowering Unified MLLM with Multi-granular Visual Generation
  ☆130Updated 11 months ago
• PKU-YuanGroup / Video-Bench
  A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!
  ☆135Updated last year
• dvlab-research / Prompt-Highlighter
  [CVPR 2024] Prompt Highlighter: Interactive Control for Multi-Modal LLMs
  ☆156Updated last year
• isekai-portal / Link-Context-Learning
  ☆100Updated last year
• hshjerry / VideoEspresso
  [CVPR 2025 Oral] VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection
  ☆129Updated 4 months ago
• ShareGPT4Omni / ShareGPT4V
  [ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions
  ☆245Updated last year
• ziqipang / LM4VisualEncoding
  [ICLR 2024 (Spotlight)] "Frozen Transformers in Language Models are Effective Visual Encoder Layers"
  ☆246Updated last year
• hmxiong / StreamChat
  Official repo for "Streaming Video Understanding and Multi-round Interaction with Memory-enhanced Knowledge" ICLR2025
  ☆91Updated 9 months ago
• rese1f / aurora
  [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark
  ☆135Updated 6 months ago
• Beckschen / LLaVolta
  [NeurIPS 2024] Efficient Large Multi-modal Models via Visual Context Compression
  ☆62Updated 10 months ago
• Open-Reasoner-Zero / Open-Vision-Reasoner
  [NeurIPS 2025] The official repository for our paper, "Open Vision Reasoner: Transferring Linguistic Cognitive Behavior for Visual Reason…
  ☆150Updated 3 months ago
• mll-lab-nu / TStar
  TStar is a unified temporal search framework for long-form video question answering
  ☆77Updated 3 months ago
• Yxxxb / VoCo-LLaMA
  [CVPR'2025] VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".
  ☆200Updated 6 months ago
• zeyofu / BLINK_Benchmark
  This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…
  ☆152Updated 2 months ago
• MMStar-Benchmark / MMStar
  [NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"
  ☆200Updated last year
• TIGER-AI-Lab / Pixel-Reasoner
  Pixel-Level Reasoning Model trained with RL [NeuIPS25]
  ☆254Updated last month
• egolife-ai / Ego-R1
  Ego-R1: Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoning
  ☆133Updated 4 months ago
• bronyayang / Law_of_Vision_Representation_in_MLLMs
  [COLM'25] Official implementation of the Law of Vision Representation in MLLMs
  ☆171Updated 2 months ago
• OpenGVLab / MMIU
  [ICLR2025] MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Models
  ☆92Updated last year
• TencentARC / ST-LLM
  [ECCV 2024🔥] Official implementation of the paper "ST-LLM: Large Language Models Are Effective Temporal Learners"
  ☆151Updated last year
• imagegridworth / IG-VLM
  ☆140Updated last year
• UMass-Embodied-AGI / Mirage
  Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokens (arXiv 2025)
  ☆207Updated 4 months ago
• zzxslp / SoM-LLaVA
  [COLM-2024] List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs
  ☆145Updated last year
• Gabesarch / grounded-rl
  ☆111Updated 4 months ago
• OpenGVLab / LCL
  [NeurIPS 2024] Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning
  ☆70Updated 10 months ago
• RifleZhang / LLaVA-Hound-DPO
  ☆155Updated last year
• dongyh20 / Insight-V
  [CVPR2025 Highlight] Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models
  ☆229Updated last month