bytedance / video-SALMONN-2Links
video-SALMONN 2 is a powerful audio-visual large language model (LLM) that generates high-quality audio-visual video captions, which is developed by the Department of Electronic Engineering at Tsinghua University and ByteDance.
☆123Updated last month
Alternatives and similar repositories for video-SALMONN-2
Users that are interested in video-SALMONN-2 are comparing it to the libraries listed below
Sorting:
- ☆80Updated 8 months ago
- ☆78Updated 7 months ago
- ☆37Updated 3 months ago
- Official PyTorch implementation of EMOVA in CVPR 2025 (https://arxiv.org/abs/2409.18042)☆74Updated 8 months ago
- A Simple Framework of Small-scale LMMs for Video Understanding☆103Updated 5 months ago
- (ICCV2025) Official repository of paper "ViSpeak: Visual Instruction Feedback in Streaming Videos"☆40Updated 5 months ago
- LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.☆37Updated last year
- [ICCV 2025] Explore the Limits of Omni-modal Pretraining at Scale☆121Updated last year
- ☆135Updated last month
- ☆35Updated 6 months ago
- LMM solved catastrophic forgetting, AAAI2025☆44Updated 7 months ago
- Official implementation of paper AdaReTaKe: Adaptive Redundancy Reduction to Perceive Longer for Video-language Understanding☆88Updated 7 months ago
- An official implementation of "CapRL: Stimulating Dense Image Caption Capabilities via Reinforcement Learning"☆147Updated last month
- [CVPR 2025]Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reaction☆149Updated 8 months ago
- (NIPS 2025) OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Align…☆112Updated 3 weeks ago
- [Arxiv 2024] Official code for MMTrail: A Multimodal Trailer Video Dataset with Language and Music Descriptions☆33Updated 10 months ago
- A project for tri-modal LLM benchmarking and instruction tuning.☆52Updated 8 months ago
- Video dataset dedicated to portrait-mode video recognition.☆55Updated last month
- Official Implementation of LaViDa: :A Large Diffusion Language Model for Multimodal Understanding☆174Updated last month
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆133Updated 6 months ago
- A unified framework for controllable caption generation across images, videos, and audio. Supports multi-modal inputs and customizable ca…☆52Updated 4 months ago
- ☆181Updated 9 months ago
- The official implement of VITA, VITA15, LongVITA, VITA-Audio, VITA-VLA, and VITA-E.☆129Updated last month
- ☆141Updated 4 months ago
- [NeurIPS 2025] HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generation☆72Updated 2 months ago
- AliTok: Towards Sequence Modeling Alignment between Tokenizer and Autoregressive Model☆49Updated last month
- WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMs☆34Updated 2 weeks ago
- Official implementation of "Open-o3 Video: Grounded Video Reasoning with Explicit Spatio-Temporal Evidence"☆119Updated 3 weeks ago
- Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?☆78Updated 4 months ago
- Quick Long Video Understanding☆70Updated last month