Alternatives and similar repositories for MLVU:

Users that are interested in MLVU are comparing it to the libraries listed below

• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆356Updated last month
• yuweihao / MM-Vet
  MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)
  ☆278Updated 2 months ago
• HJYao00 / DenseConnector
  【NeurIPS 2024】Dense Connector for MLLMs
  ☆154Updated 3 months ago
• FreedomIntelligence / ALLaVA
  Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model
  ☆251Updated 6 months ago
• BradyFU / Video-MME
  ✨✨Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis
  ☆442Updated last month
• FuxiaoLiu / LRV-Instruction
  [ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning
  ☆266Updated 10 months ago
• THUDM / LVBench
  LVBench: An Extreme Long Video Understanding Benchmark
  ☆74Updated 4 months ago
• TIGER-AI-Lab / Mantis
  Official code for Paper "Mantis: Multi-Image Instruction Tuning" (TMLR2024)
  ☆193Updated this week
• open-compass / MMBench
  Official Repo of "MMBench: Is Your Multi-modal Model an All-around Player?"
  ☆173Updated 4 months ago
• pkunlp-icler / FastV
  [ECCV 2024 Oral] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Langua…
  ☆335Updated last week
• TencentARC / ST-LLM
  [ECCV 2024🔥] Official implementation of the paper "ST-LLM: Large Language Models Are Effective Temporal Learners"
  ☆134Updated 4 months ago
• TIGER-AI-Lab / UniIR
  Official code for paper "UniIR: Training and Benchmarking Universal Multimodal Information Retrievers" (ECCV 2024)
  ☆120Updated 3 months ago
• X2FD / LVIS-INSTRUCT4V
  ☆132Updated last year
• bytedance / tarsier
  Tarsier -- a family of large-scale video-language models, which is designed to generate high-quality video descriptions , together with g…
  ☆185Updated this week
• RLHF-V / RLHF-V
  [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback
  ☆257Updated 4 months ago
• huangb23 / VTimeLLM
  [CVPR'2024 Highlight] Official PyTorch implementation of the paper "VTimeLLM: Empower LLM to Grasp Video Moments".
  ☆244Updated 7 months ago
• RifleZhang / LLaVA-Hound-DPO
  ☆134Updated 2 months ago
• OpenGVLab / MM-NIAH
  [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…
  ☆109Updated last month
• OpenGVLab / OmniCorpus
  OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text
  ☆302Updated 2 months ago
• tsb0601 / MMVP
  ☆304Updated 11 months ago
• MMStar-Benchmark / MMStar
  [NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"
  ☆160Updated 3 months ago
• Liuziyu77 / MMDU
  Official repository of MMDU dataset
  ☆80Updated 3 months ago
• thunlp / Muffin
  ☆59Updated 11 months ago
• yfzhang114 / SliME
  ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models
  ☆147Updated 3 weeks ago
• TIGER-AI-Lab / VLM2Vec
  This repo contains the code and data for "VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks"
  ☆109Updated 2 weeks ago
• imagegridworth / IG-VLM
  ☆130Updated 3 months ago
• baaivision / EVE
  [NeurIPS'24 Spotlight] EVE: Encoder-Free Vision-Language Models
  ☆261Updated 3 months ago
• thunlp / LLaVA-UHD
  LLaVA-UHD v2: an MLLM Integrating High-Resolution Feature Pyramid via Hierarchical Window Transformer
  ☆348Updated this week
• OpenGVLab / MM-Interleaved
  MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer
  ☆210Updated 9 months ago
• TideDra / VL-RLHF
  A RLHF Infrastructure for Vision-Language Models
  ☆145Updated 2 months ago