Alternatives and similar repositories for LLaVA-Unified:

Users that are interested in LLaVA-Unified are comparing it to the libraries listed below

• TencentARC / ST-LLM
  [ECCV 2024🔥] Official implementation of the paper "ST-LLM: Large Language Models Are Effective Temporal Learners"
  ☆137Updated 4 months ago
• llyx97 / TempCompass
  [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …
  ☆96Updated 2 months ago
• rxtan2 / Koala-video-llm
  ☆32Updated 4 months ago
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆57Updated last year
• DCDmllm / Momentor
  ☆63Updated 2 months ago
• Hritikbansal / videocon
  ☆56Updated 9 months ago
• SCZwangxiao / video-ReTaKe
  Official implementation of paper ReTaKe: Reducing Temporal and Knowledge Redundancy for Long Video Understanding
  ☆20Updated 3 weeks ago
• Hon-Wong / Elysium
  [ECCV 2024] Elysium: Exploring Object-level Perception in Videos via MLLM
  ☆66Updated 3 months ago
• keshik6 / HourVideo
  [NeurIPS 2024] Official code for HourVideo: 1-Hour Video Language Understanding
  ☆62Updated 3 weeks ago
• scofield7419 / Video-of-Thought
  Codes for ICML 2024 paper: "Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognition"
  ☆84Updated last month
• X2FD / LVIS-INSTRUCT4V
  ☆132Updated last year
• wxh1996 / VideoAgent
  ☆66Updated last month
• imagegridworth / IG-VLM
  ☆130Updated 4 months ago
• Yui010206 / CREMA
  [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆39Updated last week
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆57Updated 4 months ago
• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆25Updated 7 months ago
• Ziyang412 / VideoTree
  Code for paper "VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videos"
  ☆92Updated 5 months ago
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆33Updated 3 months ago
• TXH-mercury / COSA
  [ICLR2024] Codes and Models for COSA: Concatenated Sample Pretrained Vision-Language Foundation Model
  ☆41Updated last month
• whwu95 / FreeVA
  FreeVA: Offline MLLM as Training-Free Video Assistant
  ☆54Updated 7 months ago
• hshjerry / VideoEspresso
  VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection
  ☆46Updated 2 weeks ago
• longvideobench / LongVideoBench
  [Neurips 24' D&B] Official Dataloader and Evaluation Scripts for LongVideoBench.
  ☆84Updated 6 months ago
• aszala / VPEval
  VPEval Codebase from Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)
  ☆44Updated last year
• joez17 / ChatBridge
  ChatBridge, an approach to learning a unified multimodal model to interpret, correlate, and reason about various modalities without rely…
  ☆49Updated last year
• NVlabs / LITA
  ☆156Updated 3 months ago
• Liuziyu77 / MIA-DPO
  Official implement of MIA-DPO
  ☆49Updated last week
• Ahnsun / merlin
  [ECCV2024] Official code implementation of Merlin: Empowering Multimodal LLMs with Foresight Minds
  ☆89Updated 6 months ago
• showlab / MovieSeq
  [ECCV2024] Learning Video Context as Interleaved Multimodal Sequences
  ☆35Updated 2 weeks ago
• Victorwz / MLM_Filter
  Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".
  ☆44Updated last month
• RenShuhuai-Andy / TESTA
  [EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding
  ☆49Updated last year