Alternatives and similar repositories for multimodal-needle-in-a-haystack:

Users that are interested in multimodal-needle-in-a-haystack are comparing it to the libraries listed below

• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆65Updated 10 months ago
• MJ-Bench / MJ-Bench
  Official implementation for "MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?"
  ☆43Updated last month
• haonan3 / V1
  V1: Toward Multimodal Reasoning by Designing Auxiliary Task
  ☆28Updated this week
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆62Updated 6 months ago
• UW-Madison-Lee-Lab / CoBSAT
  Implementation and dataset for paper "Can MLLMs Perform Text-to-Image In-Context Learning?"
  ☆36Updated last month
• SparksJoe / Prism
  A Framework for Decoupling and Assessing the Capabilities of VLMs
  ☆42Updated 9 months ago
• shulin16 / MMInA
  Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"
  ☆42Updated last month
• UCSC-VLAA / VLAA-Thinking
  ☆43Updated this week
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆54Updated 5 months ago
• gzcch / Bingo
  ☆54Updated last year
• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆32Updated last year
• RainBowLuoCS / DEEM
  (ICLR2025 Spotlight) DEEM: Official implementation of Diffusion models serve as the eyes of large language models for image perception.
  ☆27Updated last month
• TIGER-AI-Lab / VL-Rethinker
  The official code of "VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning"
  ☆56Updated this week
• luka-group / vlm-knowledge-conflict
  Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."
  ☆42Updated 5 months ago
• thunlp / DeepPerception
  DeepPerception: Advancing R1-like Cognitive Visual Perception in MLLMs for Knowledge-Intensive Visual Grounding
  ☆48Updated 3 weeks ago
• TIGER-AI-Lab / VISTA
  The code for "VISTA: Enhancing Long-Duration and High-Resolution Video Understanding by VIdeo SpatioTemporal Augmentation" [CVPR2025]
  ☆15Updated last month
• yuhui-zh15 / AutoConverter
  Official implementation of "Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model Evaluation" (CVPR 202…
  ☆25Updated last month
• zwq2018 / Multi-modal-Self-instruct
  The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…
  ☆76Updated 2 months ago
• bethgelab / sober-reasoning
  ☆16Updated this week
• AtsuMiyai / UPD
  Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models
  ☆75Updated 7 months ago
• EvolvingLMMs-Lab / multimodal-search-r1
  ☆83Updated last week
• JieyuZ2 / TaskMeAnything
  [NeurIPS 2024] A task generation and model evaluation system for multimodal language models.
  ☆70Updated 4 months ago
• shawnricecake / Heima
  Code for Heima
  ☆40Updated 2 months ago
• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆43Updated 5 months ago
• RifleZhang / LLaVA-Reasoner-DPO
  ☆71Updated 3 months ago
• ryoungj / BoLT
  Code for "Reasoning to Learn from Latent Thoughts"
  ☆89Updated 2 weeks ago
• sail-sg / MMCBench
  ☆27Updated last year
• si0wang / VisVM
  ☆38Updated 3 months ago
• mlfoundations / VisIT-Bench
  ☆50Updated last year
• OpenSparseLLMs / Open-Pandora
  Open-Pandora: On-the-fly Control Video Generation
  ☆33Updated 4 months ago