Tencent / VITALinks
The official implement of VITA, VITA15, LongVITA, VITA-Audio, VITA-VLA, and VITA-E.
☆147Updated 3 months ago
Alternatives and similar repositories for VITA
Users that are interested in VITA are comparing it to the libraries listed below
Sorting:
- video-SALMONN 2 is a powerful audio-visual large language model (LLM) that generates high-quality audio-visual video captions, which is d…☆150Updated last week
- Visual Embodied Brain: Let Multimodal Large Language Models See, Think, and Control in Spaces☆87Updated 8 months ago
- (ICCV2025) Official repository of paper "ViSpeak: Visual Instruction Feedback in Streaming Videos"☆45Updated 7 months ago
- Official PyTorch implementation of EMOVA in CVPR 2025 (https://arxiv.org/abs/2409.18042)☆76Updated 10 months ago
- [ICCV 2025] Explore the Limits of Omni-modal Pretraining at Scale☆122Updated last year
- ☆39Updated 5 months ago
- MiMo-Embodied☆349Updated 2 months ago
- ☆37Updated 8 months ago
- [CVPR 2025] Online Video Understanding: OVBench and VideoChat-Online☆88Updated 4 months ago
- [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion☆55Updated 7 months ago
- Official code for MotionBench (CVPR 2025)☆63Updated 11 months ago
- Official code of "RoboOmni: Proactive Robot Manipulation in Omni-modal Context"☆81Updated 2 months ago
- ☆185Updated last year
- Official implementation of EgoThinker at NIPS 2025☆23Updated 2 months ago
- ☆82Updated 11 months ago
- This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"☆31Updated last year
- A Simple Framework of Small-scale LMMs for Video Understanding☆108Updated 7 months ago
- ☆148Updated 6 months ago
- WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMs☆38Updated 2 weeks ago
- [NIPS2025] VideoChat-R1 & R1.5: Enhancing Spatio-Temporal Perception and Reasoning via Reinforcement Fine-Tuning☆256Updated 3 months ago
- Official implementation of "Open-o3 Video: Grounded Video Reasoning with Explicit Spatio-Temporal Evidence"☆129Updated last month
- Vinci: A Real-time Embodied Smart Assistant based on Egocentric Vision-Language Model☆81Updated 2 months ago
- LAVIS - A One-stop Library for Language-Vision Intelligence☆48Updated last year
- [EMNLP 2024] A Video Chat Agent with Temporal Prior☆32Updated 11 months ago
- ☆33Updated 9 months ago
- HumanOmni☆216Updated 10 months ago
- Towards training VQ-VAE models robustly!☆91Updated 6 months ago
- UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model☆22Updated last year
- [arXiv: 2502.05178] QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation☆95Updated 11 months ago
- The official implementation of "DynamicVLA: A Vision-Language-Action Model for Dynamic Object Manipulation". (arXiv 2601.22153)☆118Updated last week