JUNJIE99 / MLVU
🔥🔥MLVU: Multi-task Long Video Understanding Benchmark
☆175Updated this week
Alternatives and similar repositories for MLVU:
Users that are interested in MLVU are comparing it to the libraries listed below
- Long Context Transfer from Language to Vision☆360Updated 3 months ago
- Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model☆255Updated 7 months ago
- This repo contains the code for "VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks" [ICLR25]☆142Updated last week
- 【NeurIPS 2024】Dense Connector for MLLMs☆156Updated 4 months ago
- Official code for Paper "Mantis: Multi-Image Instruction Tuning" [TMLR2024]☆199Updated this week
- [ECCV 2024 Oral] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Langua…☆364Updated last month
- [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…☆109Updated 2 months ago
- Official repository of MMDU dataset☆83Updated 4 months ago
- [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback☆265Updated 5 months ago
- Codes for ICML 2024 paper: "Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognition"☆94Updated 2 months ago
- (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.☆328Updated last month
- OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text☆309Updated 3 months ago
- ☆138Updated 3 months ago
- Official code for paper "UniIR: Training and Benchmarking Universal Multimodal Information Retrievers" (ECCV 2024)☆126Updated 4 months ago
- A Survey on Benchmarks of Multimodal Large Language Models☆87Updated last month
- ☆132Updated last year
- [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …☆101Updated 2 weeks ago
- official impelmentation of Kangaroo: A Powerful Video-Language Model Supporting Long-context Video Input☆63Updated 5 months ago
- ☆59Updated last year
- ☆308Updated last year
- ✨✨Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis☆461Updated 2 months ago
- MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)☆285Updated last month
- [CVPR'2024 Highlight] Official PyTorch implementation of the paper "VTimeLLM: Empower LLM to Grasp Video Moments".☆250Updated 8 months ago
- The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''☆197Updated 10 months ago
- [NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"☆165Updated 4 months ago
- Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Models☆252Updated this week
- LVBench: An Extreme Long Video Understanding Benchmark☆80Updated 5 months ago
- [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts☆313Updated 7 months ago
- A RLHF Infrastructure for Vision-Language Models☆162Updated 3 months ago
- [ICLR2025] LLaVA-HR: High-Resolution Large Language-Vision Assistant☆229Updated 6 months ago