Wang-ML-Lab / multimodal-needle-in-a-haystackLinks
[NAACL 2025 Oral] Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Language Models
☆48Updated 4 months ago
Alternatives and similar repositories for multimodal-needle-in-a-haystack
Users that are interested in multimodal-needle-in-a-haystack are comparing it to the libraries listed below
Sorting:
- Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."☆45Updated 10 months ago
- Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"☆59Updated 10 months ago
- [ACL2025 Findings] Benchmarking Multihop Multimodal Internet Agents☆46Updated 6 months ago
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆43Updated last year
- Think or Not? Selective Reasoning via Reinforcement Learning for Vision-Language Models☆41Updated last month
- Official implementation for "MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?"☆47Updated 3 months ago
- Large Language Models Can Self-Improve in Long-context Reasoning☆73Updated 9 months ago
- [ICCV 2025] Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.☆150Updated 2 months ago
- Main source code of SRPO framework.☆33Updated 3 weeks ago
- Multimodal RewardBench☆46Updated 6 months ago
- Enhancing Large Vision Language Models with Self-Training on Image Comprehension.☆70Updated last year
- Github repository for "Bring Reason to Vision: Understanding Perception and Reasoning through Model Merging" (ICML 2025)☆74Updated 3 months ago
- V1: Toward Multimodal Reasoning by Designing Auxiliary Task☆35Updated 5 months ago
- Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*☆107Updated 3 months ago
- Optimizing Anytime Reasoning via Budget Relative Policy Optimization☆45Updated 2 months ago
- ☆53Updated 3 months ago
- Official implementation of "Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model Evaluation" (CVPR 202…☆36Updated 3 months ago
- [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)☆124Updated 2 months ago
- [ICLR 2025] LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization☆41Updated 6 months ago
- ☆55Updated last year
- OpenVLThinker: An Early Exploration to Vision-Language Reasoning via Iterative Self-Improvement☆108Updated last month
- The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…☆83Updated 7 months ago
- This repo contains the code for "MEGA-Bench Scaling Multimodal Evaluation to over 500 Real-World Tasks" [ICLR2025]☆76Updated 2 months ago
- Preference Learning for LLaVA☆49Updated 10 months ago
- The official code of "VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning"☆143Updated 3 months ago
- official code for "BoostStep: Boosting mathematical capability of Large Language Models via improved single-step reasoning"☆37Updated 7 months ago
- X-Reasoner: Towards Generalizable Reasoning Across Modalities and Domains☆47Updated 4 months ago
- ☆43Updated 10 months ago
- [ICLR2025] MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Models☆86Updated last year
- ☆26Updated 4 months ago