🔥 [ICLR 2025] Official Benchmark Toolkits for "Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmark"
☆45Nov 21, 2025Updated 9 months ago
Alternatives and similar repositories for vhs_benchmark
Users that are interested in vhs_benchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🔥 [ICLR 2025] Official PyTorch Model "Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmark"☆27Feb 9, 2025Updated last year
- 🧩 Official code repository for “Puzzled by Puzzles: When Vision-Language Models Can’t Take a Hint.”☆15Sep 22, 2025Updated 11 months ago
- Code for Dataset and Benchmarks Submission, Neurips 2022☆13Aug 16, 2022Updated 4 years ago
- A tool for calling (and calling out to) large language models.☆16Aug 13, 2024Updated 2 years ago
- We introduce new approach, Token Reduction using CLIP Metric (TRIM), aimed at improving the efficiency of MLLMs without sacrificing their…☆22Jan 11, 2026Updated 7 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- 🔥 [ICML 2026] Official implementation of "Are LRMs Interruptible?"☆19Jun 18, 2026Updated 2 months ago
- A Comprehensive Benchmark for Robust Multi-image Understanding☆21Sep 4, 2024Updated 2 years ago
- Echo: "Constantly Improving Image Models Need Constantly Improving Benchmarks" (ICLR 2026)☆20Jan 29, 2026Updated 7 months ago
- 🍀 Official pytorch implementation of "D2ADA: Dynamic Density-aware Active Domain Adaptation for Semantic Segmentation. Wu et al. ECCV 20…☆25Feb 2, 2023Updated 3 years ago
- VELMA agent for VLN in Street View☆31Sep 29, 2023Updated 2 years ago
- 🔥 [NeurIPS 2025] Official implementation of "Generate, but Verify: Reducing Visual Hallucination in Vision-Language Models with Retrospe…☆59Jan 22, 2026Updated 7 months ago
- ☆14Jun 11, 2024Updated 2 years ago
- ☆27Apr 30, 2026Updated 4 months ago
- ☆22Apr 24, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Ask&Confirm: Active Detail Enriching for Cross-Modal Retrieval with Partial Query (ICCV2021)☆20Dec 4, 2021Updated 4 years ago
- ☆18Sep 15, 2025Updated 11 months ago
- VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs☆57Mar 9, 2025Updated last year
- Official code repository for the main conference paper in EMNLP 2022: SubeventWriter: Iterative Sub-event Sequence Generation with Cohere…☆11Oct 16, 2022Updated 3 years ago
- Work-in-progress unofficial asynchronous API wrapper for Whatnot API.☆15Apr 18, 2024Updated 2 years ago
- 哈尔滨工业大学2023春季学期编译系统课程实验、习题、课件以及期末复习材料☆13Jul 30, 2023Updated 3 years ago
- Fast, free, easy, and object-agnostic video anonymization☆12Dec 12, 2020Updated 5 years ago
- VHTest☆16Oct 31, 2024Updated last year
- Official code for CVPR 2024 paper, "Audio-Visual Segmentation via Unlabeled Frame Exploitation""☆19Jul 7, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [ACL 2025 Long Main] Language Model Fine-Tuning on Scaled Survey Data for Predicting Distributions of Public Opinions☆45Apr 21, 2025Updated last year
- COLA: Evaluate how well your vision-language model can Compose Objects Localized with Attributes!☆25May 14, 2026Updated 3 months ago
- This is the official supplementary document for the GCT data and its prediction task.☆10Feb 19, 2024Updated 2 years ago
- 🚀 [NeurIPS24] Make Vision Matter in Visual-Question-Answering (VQA)! Introducing NaturalBench, a vision-centric VQA benchmark (NeurIPS'2…☆90Jun 24, 2025Updated last year
- Code & data for EMNLP 2020 paper "MOCHA: A Dataset for Training and Evaluating Reading Comprehension Metrics".☆16May 3, 2022Updated 4 years ago
- Pytorch Datasets for Easy-To-Hard☆30Jan 9, 2025Updated last year
- Rotrics Code☆10Mar 21, 2021Updated 5 years ago
- ☆10Sep 25, 2019Updated 6 years ago
- Text Summarization on Spotify Podcast Transcripts for NLP class at @UNIBO☆17Jul 2, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [COLM'25] Official implementation of the Law of Vision Representation in MLLMs☆179Oct 6, 2025Updated 10 months ago
- Code and Data for ACL 2023 paper I Spy a Metaphor: Large Language Models and Diffusion Models Co-Create Visual Metaphors☆17Jun 7, 2023Updated 3 years ago
- [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…☆129Nov 25, 2024Updated last year
- Holistic evaluation of multimodal foundation models☆48Aug 11, 2024Updated 2 years ago
- ACL 2021 paper "Style is NOT a single variable: Case Studies for Cross-Style Language Understanding " by Dongyeop Kang and Eduard Hovy☆15Jul 19, 2021Updated 5 years ago
- ☆21Nov 13, 2023Updated 2 years ago
- [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.☆89Nov 10, 2024Updated last year