Alternatives and similar repositories for ml-mia-bench

Users that are interested in ml-mia-bench are comparing it to the libraries listed below

• SparksJoe / Prism
  A Framework for Decoupling and Assessing the Capabilities of VLMs
  ☆44Updated last year
• mlfoundations / VisIT-Bench
  ☆50Updated last year
• zwq2018 / Multi-modal-Self-instruct
  The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…
  ☆83Updated 6 months ago
• Victorwz / MLM_Filter
  Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".
  ☆63Updated 3 months ago
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆58Updated 9 months ago
• TIGER-AI-Lab / MEGA-Bench
  This repo contains the code for "MEGA-Bench Scaling Multimodal Evaluation to over 500 Real-World Tasks" [ICLR2025]
  ☆73Updated last month
• shulin16 / MMInA
  [ACL2025 Findings] Benchmarking Multihop Multimodal Internet Agents
  ☆46Updated 5 months ago
• OFA-Sys / TouchStone
  Touchstone: Evaluating Vision-Language Models by Language Models
  ☆83Updated last year
• OpenGVLab / V2PE
  [ArXiv] V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encoding
  ☆54Updated 7 months ago
• yunfeixie233 / ViGaL
  ☆50Updated last month
• TIGER-AI-Lab / VisualWebInstruct
  The official repo for "VisualWebInstruct: Scaling up Multimodal Instruction Data through Web Search"
  ☆26Updated 3 months ago
• DAMO-NLP-SG / multimodal_textbook
  [ICCV 2025 Highlight] The official repository for "2.5 Years in Class: A Multimodal Textbook for Vision-Language Pretraining"
  ☆168Updated 4 months ago
• FudanNLPLAB / MouSi
  ☆73Updated last year
• OpenGVLab / MMIU
  [ICLR2025] MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Models
  ☆85Updated 10 months ago
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆95Updated last year
• chenllliang / G1
  G1: Bootstrapping Perception and Reasoning Abilities of Vision-Language Model via Reinforcement Learning
  ☆77Updated 2 months ago
• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆47Updated 9 months ago
• facebookresearch / multimodal_rewardbench
  Multimodal RewardBench
  ☆42Updated 5 months ago
• ZJU-REAL / LAPO
  ☆26Updated 2 weeks ago
• chenllliang / MMEvalPro
  [NAACL 2025] Source code for MMEvalPro, a more trustworthy and efficient benchmark for evaluating LMMs
  ☆24Updated 10 months ago
• yuecao0119 / MMInstruct
  [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…
  ☆55Updated 9 months ago
• foundation-multimodal-models / CAPTURE
  ☆66Updated last year
• kxfan2002 / SophiaVL-R1
  SophiaVL-R1: Reinforcing MLLMs Reasoning with Thinking Reward
  ☆72Updated this week
• Wang-ML-Lab / multimodal-needle-in-a-haystack
  [NAACL 2025 Oral] Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Language Models
  ☆48Updated 3 months ago
• MAmmoTH-VL / MAmmoTH-VL
  (ACL 2025) MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale
  ☆47Updated 2 months ago
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆105Updated 2 months ago
• Liuziyu77 / MMDU
  Official repository of MMDU dataset
  ☆93Updated 10 months ago
• SihengLi99 / TextBind
  [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation
  ☆47Updated last year
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆145Updated 8 months ago
• MBZUAI-LLM / web2code
  Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs
  ☆87Updated 9 months ago