Alternatives and similar repositories for VITA

Users that are interested in VITA are comparing it to the libraries listed below

• bytedance / video-SALMONN-2
  video-SALMONN 2 is a powerful audio-visual large language model (LLM) that generates high-quality audio-visual video captions, which is d…
  ☆132Updated this week
• invictus717 / MiCo
  [ICCV 2025] Explore the Limits of Omni-modal Pretraining at Scale
  ☆121Updated last year
• HumanMLLM / ViSpeak
  (ICCV2025) Official repository of paper "ViSpeak: Visual Instruction Feedback in Streaming Videos"
  ☆44Updated 5 months ago
• BriansIDP / video-SALMONN-o1
  ☆37Updated 4 months ago
• JaaackHongggg / WorldSense
  WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMs
  ☆34Updated last month
• emova-ollm / EMOVA
  Official PyTorch implementation of EMOVA in CVPR 2025 (https://arxiv.org/abs/2409.18042)
  ☆75Updated 9 months ago
• OpenGVLab / VideoChat-R1
  [NIPS2025] VideoChat-R1 & R1.5: Enhancing Spatio-Temporal Perception and Reasoning via Reinforcement Fine-Tuning
  ☆249Updated 2 months ago
• OpenGVLab / VeBrain
  Visual Embodied Brain: Let Multimodal Large Language Models See, Think, and Control in Spaces
  ☆87Updated 6 months ago
• Mark12Ding / Dispider
  [CVPR 2025]Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reaction
  ☆153Updated 9 months ago
• AV-Odyssey / AV-Odyssey
  This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"
  ☆31Updated last year
• ZhangXJ199 / TinyLLaVA-Video
  A Simple Framework of Small-scale LMMs for Video Understanding
  ☆106Updated 6 months ago
• 360CVGroup / Inner-Adaptor-Architecture
  LMM solved catastrophic forgetting, AAAI2025
  ☆44Updated 8 months ago
• FrankYang-17 / MME-VideoOCR
  ☆36Updated 6 months ago
• OpenMOSS / RoboOmni
  Official code of "RoboOmni: Proactive Robot Manipulation in Omni-modal Context"
  ☆75Updated last month
• WHB139426 / Grounded-Video-LLM
  [EMNLP 2025 Findings] Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Models
  ☆138Updated 4 months ago
• rese1f / aurora
  [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark
  ☆137Updated 6 months ago
• zai-org / MotionBench
  Official code for MotionBench (CVPR 2025)
  ☆61Updated 9 months ago
• JoeLeelyf / OVO-Bench
  [CVPR 2025] OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?
  ☆111Updated 5 months ago
• baichuan-inc / Baichuan-Omni-1.5
  ☆183Updated 10 months ago
• Kwai-YuanQi / MM-RLHF
  The Next Step Forward in Multimodal LLM Alignment
  ☆193Updated 7 months ago
• HumanMLLM / HumanOmniV2
  ☆144Updated 4 months ago
• EvolvingLMMs-Lab / VideoMMMU
  ☆62Updated 3 months ago
• Yxxxb / VoCo-LLaMA
  [CVPR'2025] VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".
  ☆202Updated 6 months ago
• zehanwang01 / OmniBind
  ☆33Updated 8 months ago
• IVGSZ / Flash-VStream
  This is the official implementation of ICCV 2025 "Flash-VStream: Efficient Real-Time Understanding for Long Video Streams"
  ☆255Updated 2 months ago
• hmxiong / StreamChat
  Official repo for "Streaming Video Understanding and Multi-round Interaction with Memory-enhanced Knowledge" ICLR2025
  ☆93Updated 9 months ago
• hyc2026 / StoryTeller
  ☆80Updated 9 months ago
• xjtupanda / Sparrow
  Repo for paper "T2Vid: Translating Long Text into Multi-Image is the Catalyst for Video-LLMs"
  ☆48Updated 3 months ago
• JiuTian-VL / MoME
  [NeurIPS 2024] MoME: Mixture of Multimodal Experts for Generalist Multimodal Large Language Models
  ☆76Updated 7 months ago
• HarryHsing / EchoInk
  EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning [🔥The Exploration of R1 for General Audio-Vi…
  ☆70Updated 7 months ago