🔥 [ICLR 2025] Official Benchmark Toolkits for "Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmark"
☆44Nov 21, 2025Updated 10 months ago
Alternatives and similar repositories for vhs_benchmark
Users that are interested in vhs_benchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🔥 [ICLR 2025] Official PyTorch Model "Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmark"☆26Feb 9, 2025Updated last year
- We introduce new approach, Token Reduction using CLIP Metric (TRIM), aimed at improving the efficiency of MLLMs without sacrificing their…☆23Jan 11, 2026Updated 8 months ago
- 🔥 [ICML 2026] Official implementation of "Are LRMs Interruptible?"☆20Jun 18, 2026Updated 3 months ago
- A Comprehensive Benchmark for Robust Multi-image Understanding☆21Sep 4, 2024Updated 2 years ago
- Echo: "Constantly Improving Image Models Need Constantly Improving Benchmarks" (ICLR 2026)☆20Jan 29, 2026Updated 7 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- 🍀 Official pytorch implementation of "D2ADA: Dynamic Density-aware Active Domain Adaptation for Semantic Segmentation. Wu et al. ECCV 20…☆25Feb 2, 2023Updated 3 years ago
- VELMA agent for VLN in Street View☆31Sep 29, 2023Updated 2 years ago
- 🔥 [NeurIPS 2025] Official implementation of "Generate, but Verify: Reducing Visual Hallucination in Vision-Language Models with Retrospe…☆59Jan 22, 2026Updated 8 months ago
- ☆22Apr 24, 2025Updated last year
- The goal of this experiment is to take articles and certain metadata and group them by topic.☆11Apr 14, 2016Updated 10 years ago
- Ask&Confirm: Active Detail Enriching for Cross-Modal Retrieval with Partial Query (ICCV2021)☆20Dec 4, 2021Updated 4 years ago
- VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs☆57Mar 9, 2025Updated last year
- Official code repository for the main conference paper in EMNLP 2022: SubeventWriter: Iterative Sub-event Sequence Generation with Cohere…☆11Oct 16, 2022Updated 3 years ago
- Official Repository of VisGym: Diverse, Customizable, Scalable Environments for Multimodal Agents☆115May 3, 2026Updated 4 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch☆29Aug 29, 2026Updated 3 weeks ago
- Official code for CVPR 2024 paper, "Audio-Visual Segmentation via Unlabeled Frame Exploitation""☆19Jul 7, 2024Updated 2 years ago
- [ACL 2025 Long Main] Language Model Fine-Tuning on Scaled Survey Data for Predicting Distributions of Public Opinions☆48Apr 21, 2025Updated last year
- CLAIR: A (surprisingly) simple semantic text metric with large language models.☆23Jan 28, 2024Updated 2 years ago
- 🚀 [NeurIPS24] Make Vision Matter in Visual-Question-Answering (VQA)! Introducing NaturalBench, a vision-centric VQA benchmark (NeurIPS'2…☆90Jun 24, 2025Updated last year
- Codebase, data and models for the Headline Grouping paper at NAACL2021☆12Oct 2, 2022Updated 3 years ago
- [COLM'25] Official implementation of the Law of Vision Representation in MLLMs☆179Oct 6, 2025Updated 11 months ago
- Code and Data for ACL 2023 paper I Spy a Metaphor: Large Language Models and Diffusion Models Co-Create Visual Metaphors☆17Jun 7, 2023Updated 3 years ago
- [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…☆130Nov 25, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Holistic evaluation of multimodal foundation models☆48Aug 11, 2024Updated 2 years ago
- [ACM Computing Survey 2025] Vertical Federated Learning for Effectiveness, Security, Applicability: A Survey, by MARS Group at Wuhan Univ…☆23Apr 9, 2025Updated last year
- [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.☆91Nov 10, 2024Updated last year
- Code release for "MORE: Multi-mOdal REtrieval Augmented Generative Commonsense Reasoning"☆11Oct 11, 2024Updated last year
- Implementation of the Unsupervised learning by predicting noise paper☆14Jan 18, 2018Updated 8 years ago
- learning materials of driveos from nvidia drive sdk.☆13Jun 10, 2026Updated 3 months ago
- An LLM-free Multi-dimensional Benchmark for Multi-modal Hallucination Evaluation☆174Jan 15, 2024Updated 2 years ago
- ☆28Jul 22, 2026Updated 2 months ago
- Repository for paper Visual-RAG: Benchmarking Text-to-Image Retrieval Augmented Generation for Visual Knowledge Intensive Queries☆13Jul 16, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- a set of tools for computer vision processing☆18Jul 9, 2016Updated 10 years ago
- Official code repository for Findings of EMNLP 2022 paper: PseudoReasoner: Leveraging Pseudo Labels for Commonsense Knowledge Base Popula…☆11Oct 18, 2022Updated 3 years ago
- Iterate on LLM-based structured generation forward and backward☆24Mar 20, 2025Updated last year
- [CVPR23 Highlight] CREPE: Can Vision-Language Foundation Models Reason Compositionally?☆36Apr 27, 2023Updated 3 years ago
- Code release for "UnSAMv2: Self-Supervised Learning Enables Segment Anything at Any Granularity"☆86Sep 15, 2026Updated last week
- ☆117Sep 13, 2025Updated last year
- ☆34May 14, 2025Updated last year