Tencent / VITALinks
The official implement of VITA, VITA15, LongVITA, and VITA-Audio.
☆34Updated 2 months ago
Alternatives and similar repositories for VITA
Users that are interested in VITA are comparing it to the libraries listed below
Sorting:
- ☆56Updated 3 months ago
- ☆176Updated 7 months ago
- video-SALMONN 2 is a powerful audio-visual large language model (LLM) that generates high-quality audio-visual video captions, which is d…☆78Updated last week
- Official PyTorch implementation of EMOVA in CVPR 2025 (https://arxiv.org/abs/2409.18042)☆71Updated 6 months ago
- ☆78Updated 6 months ago
- LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.☆37Updated last year
- [ICCV 2025] Explore the Limits of Omni-modal Pretraining at Scale☆116Updated last year
- A project for tri-modal LLM benchmarking and instruction tuning.☆48Updated 6 months ago
- ☆21Updated 8 months ago
- (NIPS 2025) OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Align…☆100Updated 2 weeks ago
- ☆78Updated 5 months ago
- ☆35Updated last month
- UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model☆22Updated last year
- LMM solved catastrophic forgetting, AAAI2025☆44Updated 5 months ago
- 🤗 R1-AQA Model: mispeech/r1-aqa☆300Updated 6 months ago
- HumanOmni☆195Updated 6 months ago
- This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"☆29Updated 9 months ago
- The official implement of Freeze-Omni.☆13Updated 2 months ago
- LUCY: Linguistic Understanding and Control Yielding Early Stage of Her☆55Updated 5 months ago
- EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning [🔥The Exploration of R1 for General Audio-Vi…☆57Updated 4 months ago
- Baichuan-Omni: Towards Capable Open-source Omni-modal LLM 🌊☆269Updated 8 months ago
- A Foundation Model for Industrial Signal Comprehensive Representation☆43Updated last month
- Ming - facilitating advanced multimodal understanding and generation capabilities built upon the Ling LLM.☆470Updated last week
- (ICCV2025) Official repository of paper "ViSpeak: Visual Instruction Feedback in Streaming Videos"☆40Updated 3 months ago
- ☆33Updated 5 months ago
- SpeechAgents: Human-Communication Simulation with Multi-Modal Multi-Agent Systems☆84Updated last year
- [ACL2025 Findings] Migician: Revealing the Magic of Free-Form Multi-Image Grounding in Multimodal Large Language Models☆77Updated 4 months ago
- ☆99Updated this week
- ☆61Updated last week
- Kling-Foley: Multimodal Diffusion Transformer for High-Quality Video-to-Audio Generation☆59Updated 3 months ago