Alternatives and similar repositories for M4

Users that are interested in M4 are comparing it to the libraries listed below

• OmniMMI / OmniMMI
  [CVPR 2025] OmniMMI: A Comprehensive Multi-modal Interaction Benchmark in Streaming Video Contexts
  ☆21Updated last month
• SihengLi99 / TextBind
  [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation
  ☆47Updated 2 years ago
• kiaia / GIRAFFE
  Extending context length of visual language models
  ☆12Updated last year
• lscpku / VITATECS
  ☆18Updated last year
• patrick-tssn / VSTAR
  [ACL 2023] VSTAR is a multimodal dialogue dataset with scene and topic transition information
  ☆15Updated last year
• facebookresearch / multimodal_rewardbench
  Multimodal RewardBench
  ☆60Updated 11 months ago
• kaistAI / Volcano
  [NAACL 2024] Vision language model that reduces hallucinations through self-feedback guided revision. Visualizes attentions on image feat…
  ☆47Updated last year
• mshukor / ima-lmms
  [NeurIPS2024] Official code for (IMA) Implicit Multimodal Alignment: On the Generalization of Frozen LLMs to Multimodal Inputs
  ☆24Updated last year
• TIGER-AI-Lab / VisualWebInstruct
  The official repo for "VisualWebInstruct: Scaling up Multimodal Instruction Data through Web Search" [EMNLP25]
  ☆37Updated 4 months ago
• zeyofu / ReFocus_Code
  Codes for ReFocus: Visual Editing as a Chain of Thought for Structured Image Understanding [ICML 2025]]
  ☆45Updated 6 months ago
• TIGER-AI-Lab / VISTA
  The code for "VISTA: Enhancing Long-Duration and High-Resolution Video Understanding by VIdeo SpatioTemporal Augmentation" [CVPR2025]
  ☆20Updated 11 months ago
• TobiasLee / VEC
  Visual and Embodied Concepts evaluation benchmark
  ☆21Updated 2 years ago
• HongbangYuan / OmniReward
  ☆39Updated last month
• mu-cai / TemporalBench
  TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Models
  ☆37Updated last year
• Yifan-Song793 / GoodBadGreedy
  The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism
  ☆30Updated last year
• multimodal-art-projection / IV-Bench
  ☆13Updated 9 months ago
• DAMO-NLP-SG / CMM
  ✨✨The Curse of Multi-Modalities (CMM): Evaluating Hallucinations of Large Multimodal Models across Language, Visual, and Audio
  ☆53Updated 6 months ago
• THUNLP-MT / EscapeCraft
  Official repo for EscapeCraft (an 3D environment for room escape) and benchmark MM-Escape. This work is accepted by ICCV 2025.
  ☆36Updated 6 months ago
• yale-nlp / TOMATO
  ☆37Updated last year
• Share14 / ShareGemini
  ☆32Updated last year
• hkust-nlp / mstar
  [ICML 2025] M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning
  ☆70Updated 6 months ago
• OpenCausaLab / CELLO
  ☆21Updated last year
• multimodal-art-projection / OmniBench
  A project for tri-modal LLM benchmarking and instruction tuning.
  ☆56Updated 10 months ago
• shiqichen17 / AdaptVis
  Github repository for "Why Is Spatial Reasoning Hard for VLMs? An Attention Mechanism Perspective on Focus Areas" (ICML 2025)
  ☆68Updated 8 months ago
• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆58Updated last year
• chenllliang / G1
  G1: Bootstrapping Perception and Reasoning Abilities of Vision-Language Model via Reinforcement Learning
  ☆95Updated 8 months ago
• CASIA-IVA-Lab / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆54Updated 10 months ago
• TIGER-AI-Lab / MEGA-Bench
  This repo contains the code for "MEGA-Bench Scaling Multimodal Evaluation to over 500 Real-World Tasks" [ICLR 2025]
  ☆77Updated 7 months ago
• MengLcool / DeepStack-VL
  [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…
  ☆77Updated last year
• path2generalist / General-Level
  On Path to Multimodal Generalist: General-Level and General-Bench
  ☆19Updated 6 months ago