Alternatives and similar repositories for MLLM-Tool:

Users that are interested in MLLM-Tool are comparing it to the libraries listed below

• rongyaofang / PUMA
  Empowering Unified MLLM with Multi-granular Visual Generation
  ☆119Updated 3 months ago
• Haochen-Wang409 / ross
  [ICLR'25] Reconstructive Visual Instruction Tuning
  ☆78Updated last week
• shxie2020 / Awesome-UGVFM
  A collection of vision foundation models unifying understanding and generation.
  ☆50Updated 3 months ago
• PKU-YuanGroup / Video-Bench
  A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!
  ☆125Updated last year
• 42Shawn / LLaVA-PruMerge
  LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models
  ☆124Updated 11 months ago
• yu-rp / VisualPerceptionToken
  ☆60Updated 3 weeks ago
• mit-han-lab / vila-u
  [ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation
  ☆280Updated 2 months ago
• AILab-CVC / VL-GPT
  VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation
  ☆86Updated 7 months ago
• bronyayang / Law_of_Vision_Representation_in_MLLMs
  Official implementation of the Law of Vision Representation in MLLMs
  ☆153Updated 5 months ago
• GuangyanS / Sys2-LLaVA
  ☆21Updated 2 months ago
• PKU-YuanGroup / WISE
  WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generation
  ☆75Updated last week
• NVlabs / QLIP
  [arXiv: 2502.05178] QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation
  ☆68Updated last month
• Cooperx521 / PyramidDrop
  (CVPR 2025) PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction
  ☆89Updated last month
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆64Updated 7 months ago
• ByteFlow-AI / TokenFlow
  [CVPR 2025] 🔥 Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".
  ☆312Updated last month
• TencentARC / SEED-Bench-R1
  ☆72Updated last week
• MMStar-Benchmark / MMStar
  [NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"
  ☆174Updated 6 months ago
• xichenpan / Kosmos-G
  Official Implementation of ICLR'24: Kosmos-G: Generating Images in Context with Multimodal Large Language Models
  ☆70Updated 10 months ago
• rese1f / aurora
  [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark
  ☆90Updated this week
• Yxxxb / VoCo-LLaMA
  [CVPR'2025] VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".
  ☆151Updated last month
• dongyh20 / Insight-V
  [CVPR2025 Highlight] Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models
  ☆182Updated 2 weeks ago
• Purshow / Awesome-Unified-Multimodal
  📖 This is a repository for organizing papers, codes, and other resources related to unified multimodal models.
  ☆171Updated last week
• z-x-yang / DoraemonGPT
  Official repository of DoraemonGPT: Toward Understanding Dynamic Scenes with Large Language Models
  ☆83Updated 7 months ago
• llyx97 / TempCompass
  [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …
  ☆110Updated 2 weeks ago
• OpenGVLab / LCL
  [NeurIPS 2024] Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning
  ☆69Updated 2 months ago
• JoeLeelyf / OVO-Bench
  [CVPR 2025] OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?
  ☆53Updated 2 weeks ago
• facebookresearch / metamorph
  Code for MetaMorph Multimodal Understanding and Generation via Instruction Tuning
  ☆86Updated this week
• songweii / DualToken
  Unifying Visual Understanding and Generation with Dual Visual Vocabularies 🌈
  ☆37Updated 3 weeks ago
• isekai-portal / Link-Context-Learning
  ☆97Updated 11 months ago
• OpenGVLab / PhyGenBench
  The code and data of Paper: Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generation
  ☆99Updated 5 months ago