Tencent / VITALinks
The official implement of VITA, VITA15, LongVITA, VITA-Audio, VITA-VLA, and VITA-E.
☆147Updated 3 months ago
Alternatives and similar repositories for VITA
Users that are interested in VITA are comparing it to the libraries listed below
Sorting:
- video-SALMONN 2 is a powerful audio-visual large language model (LLM) that generates high-quality audio-visual video captions, which is d…☆146Updated last week
- ☆39Updated 5 months ago
- Visual Embodied Brain: Let Multimodal Large Language Models See, Think, and Control in Spaces☆87Updated 8 months ago
- Official PyTorch implementation of EMOVA in CVPR 2025 (https://arxiv.org/abs/2409.18042)☆76Updated 10 months ago
- Official code of "RoboOmni: Proactive Robot Manipulation in Omni-modal Context"☆81Updated 2 months ago
- (ICCV2025) Official repository of paper "ViSpeak: Visual Instruction Feedback in Streaming Videos"☆45Updated 7 months ago
- ☆37Updated 8 months ago
- [ICCV 2025] Explore the Limits of Omni-modal Pretraining at Scale☆122Updated last year
- This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"☆31Updated last year
- [CVPR 2025] Online Video Understanding: OVBench and VideoChat-Online☆88Updated 4 months ago
- Official code for MotionBench (CVPR 2025)☆63Updated 11 months ago
- [CVPR 2025]Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reaction☆166Updated 10 months ago
- [EMNLP 2024] A Video Chat Agent with Temporal Prior☆32Updated 11 months ago
- WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMs☆38Updated 2 weeks ago
- LMM solved catastrophic forgetting, AAAI2025☆45Updated 9 months ago
- A Simple Framework of Small-scale LMMs for Video Understanding☆108Updated 7 months ago
- ☆148Updated 6 months ago
- EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning [🔥The Exploration of R1 for General Audio-Vi…☆73Updated 8 months ago
- MiMo-Embodied☆349Updated 2 months ago
- [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion☆55Updated 7 months ago
- [ICCV 2025] Official Repository of VideoLLaMB: Long Video Understanding with Recurrent Memory Bridges☆83Updated 11 months ago
- Code for the Molmo2 Vision-Language Model☆151Updated last month
- [NIPS2025] VideoChat-R1 & R1.5: Enhancing Spatio-Temporal Perception and Reasoning via Reinforcement Fine-Tuning☆256Updated 3 months ago
- Evaluating Knowledge Acquisition from Multi-Discipline Professional Videos☆65Updated 5 months ago
- UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model☆22Updated last year
- [EMNLP 2025 Findings] Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Models☆139Updated 5 months ago
- ☆82Updated 10 months ago
- Egocentric Video Understanding Dataset (EVUD)☆32Updated last year
- [CVPR 2025] OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?☆120Updated 6 months ago
- Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?☆86Updated 6 months ago