Alternatives and similar repositories for VITA

Users that are interested in VITA are comparing it to the libraries listed below

• emova-ollm / EMOVA
  Official PyTorch implementation of EMOVA in CVPR 2025 (https://arxiv.org/abs/2409.18042)
  ☆74Updated 7 months ago
• bytedance / video-SALMONN-2
  video-SALMONN 2 is a powerful audio-visual large language model (LLM) that generates high-quality audio-visual video captions, which is d…
  ☆98Updated last week
• baichuan-inc / Baichuan-Omni-1.5
  ☆178Updated 8 months ago
• invictus717 / MiCo
  [ICCV 2025] Explore the Limits of Omni-modal Pretraining at Scale
  ☆118Updated last year
• Mark12Ding / Dispider
  [CVPR 2025]Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reaction
  ☆141Updated 7 months ago
• HarryHsing / EchoInk
  EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning [🔥The Exploration of R1 for General Audio-Vi…
  ☆60Updated 5 months ago
• HumanMLLM / HumanOmniV2
  ☆135Updated 3 months ago
• RainBowLuoCS / OpenOmni
  (NIPS 2025) OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Align…
  ☆107Updated last month
• 360CVGroup / Inner-Adaptor-Architecture
  LMM solved catastrophic forgetting, AAAI2025
  ☆44Updated 6 months ago
• AV-Odyssey / AV-Odyssey
  This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"
  ☆30Updated 10 months ago
• BriansIDP / video-SALMONN-o1
  ☆35Updated 2 months ago
• FrankYang-17 / MME-VideoOCR
  ☆34Updated 5 months ago
• ZhangXJ199 / TinyLLaVA-Video
  A Simple Framework of Small-scale LMMs for Video Understanding
  ☆95Updated 4 months ago
• HumanMLLM / ViSpeak
  (ICCV2025) Official repository of paper "ViSpeak: Visual Instruction Feedback in Streaming Videos"
  ☆40Updated 4 months ago
• westlake-baichuan-mllm / bc-omni
  Baichuan-Omni: Towards Capable Open-source Omni-modal LLM 🌊
  ☆268Updated 9 months ago
• threegold116 / Awesome-Omni-MLLMs
  This is for ACL 2025 Findings Paper: From Specific-MLLMs to Omni-MLLMs: A Survey on MLLMs Aligned with Multi-modalitiesModels
  ☆60Updated last month
• thunlp / Migician
  [ACL2025 Findings] Migician: Revealing the Magic of Free-Form Multi-Image Grounding in Multimodal Large Language Models
  ☆80Updated 5 months ago
• IVGSZ / Flash-VStream
  This is the official implementation of ICCV 2025 "Flash-VStream: Efficient Real-Time Understanding for Long Video Streams"
  ☆241Updated 2 weeks ago
• multimodal-art-projection / OmniBench
  A project for tri-modal LLM benchmarking and instruction tuning.
  ☆48Updated 7 months ago
• OpenGVLab / VideoChat-R1
  [NIPS2025] VideoChat-R1 & R1.5: Enhancing Spatio-Temporal Perception and Reasoning via Reinforcement Fine-Tuning
  ☆218Updated 2 weeks ago
• BytedanceDouyinContent / SAIL-VL2
  The SAIL-VL2 series model developed by the BytedanceDouyinContent Group
  ☆71Updated last month
• JoeLeelyf / OVO-Bench
  [CVPR 2025] OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?
  ☆100Updated 3 months ago
• xinding-sys / StreamMind
  [ICCV 2025] StreamMind: Unlocking Full Frame Rate Streaming Video Dialogue through Event-Gated Cognition
  ☆49Updated 4 months ago
• hyc2026 / StoryTeller
  ☆78Updated 7 months ago
• bigai-nlco / VideoLLaMB
  [ICCV 2025] Official Repository of VideoLLaMB: Long Video Understanding with Recurrent Memory Bridges
  ☆77Updated 8 months ago
• artemisp / LAVIS-XInstructBLIP
  LAVIS - A One-stop Library for Language-Vision Intelligence
  ☆48Updated last year
• EvolvingLMMs-Lab / VideoMMMU
  ☆60Updated last month
• Kwai-YuanQi / MM-RLHF
  The Next Step Forward in Multimodal LLM Alignment
  ☆184Updated 6 months ago
• JaaackHongggg / WorldSense
  WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMs
  ☆31Updated last month
• HumanMLLM / HumanOmni
  HumanOmni
  ☆201Updated 7 months ago