video-SALMONN 2 is a powerful audio-visual large language model (LLM) that generates high-quality audio-visual video captions, which is developed by the Department of Electronic Engineering at Tsinghua University and ByteDance.
☆219Sep 2, 2026Updated last month
Alternatives and similar repositories for video-SALMONN-2
Users that are interested in video-SALMONN-2 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This is the official repository of Daily-Omni: Towards Audio-Visual Reasoning with Temporal Alignment across Modalities☆48Jul 26, 2026Updated 2 months ago
- https://avocado-captioner.github.io/☆41Oct 16, 2025Updated 11 months ago
- [ICML 2026] Scripting Multi-Scene Videos with Time-Aware and Structural Audio-Visual Captions☆60Jun 29, 2026Updated 3 months ago
- LongVALE: Vision-Audio-Language-Event Benchmark Towards Time-Aware Omni-Modal Perception of Long Videos. (CVPR 2025))☆63Jun 9, 2025Updated last year
- ☆40Aug 26, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Structured Video Comprehension of Real-World Shorts☆243Sep 21, 2025Updated last year
- WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMs☆51Jul 12, 2026Updated 3 months ago
- ICLR 2026 Oral: WAVE: Learning Unified & Versatile Audio-Visual Embeddings with Multimodal LLM☆52Jul 30, 2026Updated 2 months ago
- ☆36Jul 9, 2025Updated last year
- F-16 is a powerful video large language model (LLM) that perceives high-frame-rate videos, which is developed by the Department of Electr…☆43Jul 3, 2025Updated last year
- [ECCV 2026] Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?☆100Jul 13, 2025Updated last year
- The Source Code for OmniVideoBench @ICLR 2026☆78Feb 12, 2026Updated 8 months ago
- [ACM MM 2025] TimeChat-online: 80% Visual Tokens are Naturally Redundant in Streaming Videos☆132Jun 29, 2026Updated 3 months ago
- Dense-Localizing Audio-Visual Events in Untrimmed Videos: A Large-Scale Benchmark and Baseline (CVPR 2023)☆73Jan 4, 2026Updated 9 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- The official code of "Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoning"☆103Oct 15, 2025Updated 11 months ago
- Video-R1: Reinforcing Video Reasoning in MLLMs [🔥the first paper to explore R1 for video]☆894Dec 14, 2025Updated 10 months ago
- [CVPR 2025] OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?☆166Jul 24, 2025Updated last year
- [CVPR 2026] Wavelet-based Frame Selection by Detecting Semantic Boundary for Long Video Understanding☆34Apr 12, 2026Updated 6 months ago
- [CVPR 2026] TimeLens: Rethinking Video Temporal Grounding with Multimodal LLMs☆185Jul 21, 2026Updated 2 months ago
- D-ORCA: Dialogue-Centric Optimization for Robust Audio-Visual Captioning☆15Aug 4, 2026Updated 2 months ago
- ☆16Jun 23, 2026Updated 3 months ago
- [ICLR 2026] Data Pipeline, Models, and Benchmark for Omni-Captioner.☆147Apr 7, 2026Updated 6 months ago
- Streaming Video Instruction Tuning☆93Feb 25, 2026Updated 7 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Official implementation of TalkNCE (ICASSP 2024).☆19Apr 30, 2025Updated last year
- StreamingVLM: Real-Time Understanding for Infinite Video Streams☆1,095Oct 15, 2025Updated last year
- StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understanding☆176May 16, 2025Updated last year
- [ICCV 2025] LVBench: An Extreme Long Video Understanding Benchmark☆155Jul 9, 2025Updated last year
- ✨✨[CVPR 2025] Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis☆799Dec 8, 2025Updated 10 months ago
- [NeurIPS 2025] Watch and Listen: Understanding Audio-Visual-Speech Moments with Multimodal LLM☆27Aug 27, 2026Updated last month
- A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.☆181Jan 30, 2025Updated last year
- [NeurIPS 2025 Spotlight] StreamForest: Efficient Online Video Understanding with Persistent Event Memory☆132Nov 4, 2025Updated 11 months ago
- [CVPR 2026] OmniZip: Audio-Guided Dynamic Token Compression for Fast Omnimodal Large Language Models☆109Apr 20, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Official repository of paper "LOVE-R1: Advancing Long Video Understanding with Adaptive Zoom-in Mechanism via Multi-Step Reasoning"☆25Nov 1, 2025Updated 11 months ago
- [ICLR 2026] An official implementation of "STAR-Bench: Probing Deep Spatio-Temporal Reasoning as Audio 4D Intelligence"☆46Apr 19, 2026Updated 5 months ago
- EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning (🔥The Exploration of R1 for General Audio-Vis…☆80Jun 3, 2026Updated 4 months ago
- 🔥🔥🔥 Latest Papers, Codes and Datasets on Video-LMM Post-Training☆305Mar 3, 2026Updated 7 months ago
- OmniVinci is an omni-modal LLM for joint understanding of vision, audio, and language.☆684Aug 31, 2026Updated last month
- Unified Audio-Visual Perception for Multi-Task Video Localization☆33Apr 19, 2024Updated 2 years ago
- [CVPR 2025] Official PyTorch code of "Enhancing Video-LLM Reasoning via Agent-of-Thoughts Distillation".☆61Jul 26, 2026Updated 2 months ago