🔥 [ICLR 2025] Official Benchmark Toolkits for "Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmark"
☆45Nov 21, 2025Updated 10 months ago
Alternatives and similar repositories for vhs_benchmark
Users that are interested in vhs_benchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🔥 [ICLR 2025] Official PyTorch Model "Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmark"☆26Feb 9, 2025Updated last year
- 🧩 Official code repository for “Puzzled by Puzzles: When Vision-Language Models Can’t Take a Hint.”☆15Sep 22, 2025Updated last year
- Code for Dataset and Benchmarks Submission, Neurips 2022☆13Aug 16, 2022Updated 4 years ago
- A tool for calling (and calling out to) large language models.☆16Aug 13, 2024Updated 2 years ago
- We introduce new approach, Token Reduction using CLIP Metric (TRIM), aimed at improving the efficiency of MLLMs without sacrificing their…☆23Jan 11, 2026Updated 9 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Tensorflow + Keras Algorithms repository for the CannyLab☆10Feb 9, 2022Updated 4 years ago
- 🔥 [ICML 2026] Official implementation of "Are LRMs Interruptible?"☆20Jun 18, 2026Updated 3 months ago
- A Comprehensive Benchmark for Robust Multi-image Understanding☆21Sep 4, 2024Updated 2 years ago
- Echo: "Constantly Improving Image Models Need Constantly Improving Benchmarks" (ICLR 2026)☆20Sep 22, 2026Updated 3 weeks ago
- 🍀 Official pytorch implementation of "D2ADA: Dynamic Density-aware Active Domain Adaptation for Semantic Segmentation. Wu et al. ECCV 20…☆25Feb 2, 2023Updated 3 years ago
- 🔥 [CVPR 2024] Official implementation of "See, Say, and Segment: Teaching LMMs to Overcome False Premises (SESAME)"☆47Jun 16, 2024Updated 2 years ago
- To mitigate position bias in LLMs, especially in long-context scenarios, we scale only one dimension of LLMs, reducing position bias and …☆12Jun 18, 2024Updated 2 years ago
- ☆17Sep 25, 2025Updated last year
- 🔥 [NeurIPS 2025] Official implementation of "Generate, but Verify: Reducing Visual Hallucination in Vision-Language Models with Retrospe…☆59Jan 22, 2026Updated 8 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆14Jun 11, 2024Updated 2 years ago
- ☆22Apr 24, 2025Updated last year
- The goal of this experiment is to take articles and certain metadata and group them by topic.☆11Apr 14, 2016Updated 10 years ago
- ☆18Sep 15, 2025Updated last year
- VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs☆57Mar 9, 2025Updated last year
- Official Repository of VisGym: Diverse, Customizable, Scalable Environments for Multimodal Agents☆117May 3, 2026Updated 5 months ago
- Work-in-progress unofficial asynchronous API wrapper for Whatnot API.☆15Apr 18, 2024Updated 2 years ago
- 哈尔滨工业大学2023春季学期编译系统课程实验、习题、课件以及期末复习材料☆13Jul 30, 2023Updated 3 years ago
- VHTest☆16Oct 31, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- COLA: Evaluate how well your vision-language model can Compose Objects Localized with Attributes!☆25May 14, 2026Updated 5 months ago
- This is the official supplementary document for the GCT data and its prediction task.☆10Feb 19, 2024Updated 2 years ago
- CLAIR: A (surprisingly) simple semantic text metric with large language models.☆23Jan 28, 2024Updated 2 years ago
- 🚀 [NeurIPS24] Make Vision Matter in Visual-Question-Answering (VQA)! Introducing NaturalBench, a vision-centric VQA benchmark (NeurIPS'2…☆90Jun 24, 2025Updated last year
- Code & data for EMNLP 2020 paper "MOCHA: A Dataset for Training and Evaluating Reading Comprehension Metrics".☆16May 3, 2022Updated 4 years ago
- ☆13Jul 31, 2023Updated 3 years ago
- ☆10Sep 25, 2019Updated 7 years ago
- LLM Beam Search Example Implementation☆13May 3, 2024Updated 2 years ago
- Codebase, data and models for the Headline Grouping paper at NAACL2021☆12Oct 2, 2022Updated 4 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Text Summarization on Spotify Podcast Transcripts for NLP class at @UNIBO☆17Jul 2, 2022Updated 4 years ago
- Code and Data for ACL 2023 paper I Spy a Metaphor: Large Language Models and Diffusion Models Co-Create Visual Metaphors☆17Jun 7, 2023Updated 3 years ago
- [COLM'25] Official implementation of the Law of Vision Representation in MLLMs☆180Oct 6, 2025Updated last year
- [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…☆129Nov 25, 2024Updated last year
- Holistic evaluation of multimodal foundation models☆48Aug 11, 2024Updated 2 years ago
- ACL 2021 paper "Style is NOT a single variable: Case Studies for Cross-Style Language Understanding " by Dongyeop Kang and Eduard Hovy☆15Jul 19, 2021Updated 5 years ago
- ☆21Nov 13, 2023Updated 2 years ago