Baiqi-Li / NaturalBench
π [NeurIPS24] Make Vision Matter in Visual-Question-Answering (VQA)! Introducing NaturalBench, a vision-centric VQA benchmark (NeurIPS'24) that challenges vision-language models with simple questions about natural imagery.
β74Updated this week
Alternatives and similar repositories for NaturalBench:
Users that are interested in NaturalBench are comparing it to the libraries listed below
- [NAACL 2025 Oral] π From redundancy to relevance: Enhancing explainability in multimodal large language modelsβ87Updated last month
- (ECCV 2024) Empowering Multimodal Large Language Model as a Powerful Data Generatorβ107Updated this week
- [ECCV 2024] Efficient Inference of Vision Instruction-Following Models with Elastic Cacheβ43Updated 8 months ago
- Chain-of-Spot: Interactive Reasoning Improves Large Vision-language Modelsβ92Updated last year
- [ICLR 2025] Mathematical Visual Instruction Tuning for Multi-modal Large Language Modelsβ130Updated 3 months ago
- A collection of multimodal reasoning papers, codes, datasets, benchmarks and resources.β122Updated this week
- Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Modelsβ170Updated 4 months ago
- [CVPR 2023] Official implementation of the paper: Fine-grained Audible Video Descriptionβ69Updated last year
- u-LLaVA: Unifying Multi-Modal Tasks via Large Language Modelβ130Updated 8 months ago
- β63Updated 2 weeks ago
- (NeurIPS 2024) Official PyTorch implementation of LOVA3β79Updated this week
- RobustFT: Robust Supervised Fine-tuning for Large Language Models under Noisy Responseβ40Updated 3 months ago
- Liquid: Language Models are Scalable and Unified Multi-modal Generatorsβ288Updated this week
- [ICLR'24] Democratizing Fine-grained Visual Recognition with Large Language Modelsβ171Updated 8 months ago
- [ECCV 2024] Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?β156Updated 6 months ago
- FACTUAL benchmark dataset, the pre-trained textual scene graph parser trained on FACTUAL.β104Updated last month
- [MM'24 Oral] Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment Retrievalβ124Updated 7 months ago
- β27Updated 4 months ago
- Multi-granularity Correspondence Learning from Long-term Noisy Videos [ICLR 2024, Oral]β113Updated 11 months ago
- WorldGPT: Empowering LLM as Multimodal World Modelβ115Updated 7 months ago
- An official implementation of VideoRoPE: What Makes for Good Video Rotary Position Embedding?β112Updated 3 weeks ago
- Official implementation of "Towards Efficient Visual Adaption via Structural Re-parameterization".β179Updated 11 months ago
- GPT4Vis: What Can GPT-4 Do for Zero-shot Visual Recognition?β186Updated 10 months ago
- The repository for the paper titled "Leopard: A Vision Language Model For Text-Rich Multi-Image Tasks"β154Updated 3 months ago
- Evaluating Vision & Language Pretraining Models with Objects, Attributes and Relations. [EMNLP 2022]β126Updated 5 months ago
- SemiEvol: Semi-supervised Fine-tuning for LLM Adaptationβ52Updated 4 months ago
- [CVPR'24 Highlight] SHiNe: Semantic Hierarchy Nexus for Open-vocabulary Object Detectionβ91Updated 8 months ago
- β¨β¨Long-VITA: Scaling Large Multi-modal Models to 1 Million Tokens with Leading Short-Context Accuracyβ263Updated last week
- [ECCV2022,oral] Identifying Hard Noise in Long-Tailed Sample Distributionβ72Updated 2 years ago
- CoS: Chain-of-Shot Prompting for Long Video Understandingβ44Updated last month