Alternatives and similar repositories for multimodal-needle-in-a-haystack

Users that are interested in multimodal-needle-in-a-haystack are comparing it to the libraries listed below

• Wang-ML-Lab / TSDA

  View on GitHub
  [ICML 2023] Taxonomy-Structured Domain Adaptation
  ☆12Oct 6, 2023Updated 2 years ago
• OpenGVLab / MM-NIAH

  View on GitHub
  [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…
  ☆123Nov 25, 2024Updated last year
• marinero4972 / CyberV

  View on GitHub
  ☆18Jun 10, 2025Updated 8 months ago
• MileBench / MileBench

  View on GitHub
  This repo contains evaluation code for the paper "MileBench: Benchmarking MLLMs in Long Context"
  ☆36Jul 11, 2024Updated last year
• Wang-ML-Lab / VDI

  View on GitHub
  [ICLR 2023 (Spotlight)] Domain-Indexing Variational Bayes: Interpretable Domain Index for Domain Adaptation
  ☆40Jan 13, 2024Updated 2 years ago
• VisualWebBench / VisualWebBench

  View on GitHub
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆63Oct 19, 2024Updated last year
• chenllliang / MMEvalPro

  View on GitHub
  [NAACL 2025] Source code for MMEvalPro, a more trustworthy and efficient benchmark for evaluating LMMs
  ☆24Sep 26, 2024Updated last year
• YujieLu10 / Seeker

  View on GitHub
  ☆11May 24, 2024Updated last year
• shikiw / Modality-Integration-Rate

  View on GitHub
  [ICCV 2025] The official code of the paper "Deciphering Cross-Modal Alignment in Large Vision-Language Models with Modality Integration R…
  ☆111Jul 9, 2025Updated 7 months ago
• pzs19 / LEMMA

  View on GitHub
  ☆16Sep 4, 2025Updated 5 months ago
• SWE-Gym / SWE-Bench-Fork

  View on GitHub
  ☆12Mar 5, 2025Updated 11 months ago
• SparksJoe / Prism

  View on GitHub
  A Framework for Decoupling and Assessing the Capabilities of VLMs
  ☆43Jun 28, 2024Updated last year
• SWE-EVO / SWE-EVO

  View on GitHub
  ☆32Jan 25, 2026Updated 2 weeks ago
• Vchitect / Uni-MMMU

  View on GitHub
  ☆21Dec 10, 2025Updated 2 months ago
• gccnlp / Light-PEFT

  View on GitHub
  [ACL 2024 Findings] Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning
  ☆13Sep 2, 2024Updated last year
• OmniMMI / M4

  View on GitHub
  [CVPR 2025] OmniMMI: A Comprehensive Multi-modal Interaction Benchmark in Streaming Video Contexts
  ☆17Apr 2, 2025Updated 10 months ago
• Sueqk / LMM-VQA

  View on GitHub
  LMM for VQA, tcsvt version
  ☆11Jul 19, 2024Updated last year
• tml-epfl / icl-alignment

  View on GitHub
  Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]
  ☆32Jan 23, 2025Updated last year
• lzhxmu / VTW

  View on GitHub
  Code release for VTW (AAAI 2025 Oral)
  ☆64Nov 4, 2025Updated 3 months ago
• eric-ai-lab / MMWorld

  View on GitHub
  Official repo of the ICLR 2025 paper "MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos"
  ☆28Jul 15, 2025Updated 6 months ago
• sail-sg / scaling-with-vocab

  View on GitHub
  [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623
  ☆89Sep 26, 2024Updated last year
• jinzhuoran / RAG-RewardBench

  View on GitHub
  RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment
  ☆16Dec 19, 2024Updated last year
• FrankYang-17 / MME-VideoOCR

  View on GitHub
  ☆37May 28, 2025Updated 8 months ago
• liuzuyan / ElasticCache

  View on GitHub
  [ECCV 2024] Efficient Inference of Vision Instruction-Following Models with Elastic Cache
  ☆43Jul 26, 2024Updated last year
• replicate / cog-safe-push

  View on GitHub
  Safely push a Cog model version by making sure it works and is backwards-compatible with previous versions.
  ☆16Dec 4, 2025Updated 2 months ago
• MING-ZCH / CII-Bench

  View on GitHub
  [ACL 2025] Can MLLMs Understand the Deep Implication Behind Chinese Images?
  ☆20Oct 20, 2025Updated 3 months ago
• kigb / DropoutDecoding

  View on GitHub
  [NeurIPS 2025] Official Implementation for "Enhancing Vision-Language Model Reliability with Uncertainty-Guided Dropout Decoding"
  ☆22Dec 8, 2024Updated last year
• LzVv123456 / VISTA

  View on GitHub
  ☆72Jul 28, 2025Updated 6 months ago
• OSU-NLP-Group / Explorer

  View on GitHub
  [ACL'25 (Findings)] Explorer: Scaling Exploration-driven Web Trajectory Synthesis for Multimodal Web Agents
  ☆26Oct 15, 2025Updated 3 months ago
• MLLM-Data-Contamination / MM-Detect

  View on GitHub
  This repo contains code for the paper "Both Text and Images Leaked! A Systematic Analysis of Data Contamination in Multimodal LLM"
  ☆17Oct 17, 2025Updated 3 months ago
• OmniMMI / OmniMMI

  View on GitHub
  [CVPR 2025] OmniMMI: A Comprehensive Multi-modal Interaction Benchmark in Streaming Video Contexts
  ☆21Dec 22, 2025Updated last month
• tmllab / 2024_ICML_DICL

  View on GitHub
  ☆18May 2, 2024Updated last year
• penghao-wu / ProxyV

  View on GitHub
  [ICML 2025] Streamline Without Sacrifice - Squeeze out Computation Redundancy in LMM
  ☆20May 22, 2025Updated 8 months ago
• quicksviewer / quicksviewer

  View on GitHub
  ☆19Jun 29, 2025Updated 7 months ago
• HumanMLLM / ViSpeak

  View on GitHub
  (ICCV2025) Official repository of paper "ViSpeak: Visual Instruction Feedback in Streaming Videos"
  ☆45Jul 1, 2025Updated 7 months ago
• massanishi / hackernews-post-datasets

  View on GitHub
  Datasets for hackernews posts
  ☆16Feb 17, 2022Updated 3 years ago
• sail-sg / ActivePRM

  View on GitHub
  ☆20Apr 16, 2025Updated 9 months ago
• deep-spin / Infinite-Video

  View on GitHub
  \infty-Video: A Training-Free Approach to Long Video Understanding via Continuous-Time Memory Consolidation
  ☆19Feb 14, 2025Updated last year
• 01yzzyu / wikiautogen

  View on GitHub
  [ICCV2025] WikiAutoGen offical page
  ☆24Feb 6, 2026Updated last week