Alternatives and similar repositories for multimodal-needle-in-a-haystack

Users that are interested in multimodal-needle-in-a-haystack are comparing it to the libraries listed below

• UW-Madison-Lee-Lab / CoBSAT
  Implementation and dataset for paper "Can MLLMs Perform Text-to-Image In-Context Learning?"
  ☆38Updated 2 months ago
• NUS-TRAIL / NoisyRollout
  NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation
  ☆64Updated 2 weeks ago
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆67Updated last year
• haonan3 / V1
  V1: Toward Multimodal Reasoning by Designing Auxiliary Task
  ☆34Updated last month
• shulin16 / MMInA
  Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"
  ☆43Updated 3 months ago
• UCSC-VLAA / VLAA-Thinking
  SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models
  ☆112Updated last month
• sail-sg / AnytimeReasoner
  Optimizing Anytime Reasoning via Budget Relative Policy Optimization
  ☆36Updated last week
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆57Updated 7 months ago
• MJ-Bench / MJ-Bench
  Official implementation for "MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?"
  ☆44Updated 3 months ago
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆84Updated 7 months ago
• shiqichen17 / VLM_Merging
  Github repository for "Bring Reason to Vision: Understanding Perception and Reasoning through Model Merging" (ICML 2025)
  ☆51Updated last week
• SparksJoe / Prism
  A Framework for Decoupling and Assessing the Capabilities of VLMs
  ☆43Updated 11 months ago
• HYPJUDY / Sparkles
  Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models
  ☆44Updated 11 months ago
• bethgelab / sober-reasoning
  A Sober Look at Language Model Reasoning
  ☆52Updated this week
• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆33Updated last year
• ML-GSAI / LLaDA-V
  ☆77Updated this week
• RUCBM / DeepCritic
  Official repository for paper "DeepCritic: Deliberate Critique with Large Language Models"
  ☆24Updated 2 weeks ago
• YiyangZhou / CSR
  [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models
  ☆74Updated 11 months ago
• pipilurj / bootstrapped-preference-optimization-BPO
  code for "Strengthening Multimodal Large Language Model with Bootstrapped Preference Optimization"
  ☆55Updated 9 months ago
• sail-sg / ActivePRM
  ☆15Updated last month
• JieyuZ2 / TaskMeAnything
  [NeurIPS 2024] A task generation and model evaluation system for multimodal language models.
  ☆71Updated 6 months ago
• RainBowLuoCS / DEEM
  (ICLR2025 Spotlight) DEEM: Official implementation of Diffusion models serve as the eyes of large language models for image perception.
  ☆34Updated 2 months ago
• JieyuZ2 / ProVision
  A instruction data generation system for multimodal language models.
  ☆33Updated 4 months ago
• GATECH-EIC / ACT
  [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…
  ☆38Updated 11 months ago
• NuoJohnChen / JudgeLRM
  ☆27Updated last month
• vlf-silkie / VLFeedback
  ☆99Updated last year
• chenllliang / G1
  G1: Bootstrapping Perception and Reasoning Abilities of Vision-Language Model via Reinforcement Learning
  ☆44Updated 2 weeks ago
• si0wang / VisVM
  ☆43Updated 5 months ago
• AtsuMiyai / UPD
  [ACL2025] Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Models
  ☆77Updated this week
• EternityYW / Gemini-Commonsense-Evaluation
  Official implementation of "Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models"
  ☆36Updated last year