video-SALMONN 2 is a powerful audio-visual large language model (LLM) that generates high-quality audio-visual video captions, which is developed by the Department of Electronic Engineering at Tsinghua University and ByteDance.
☆204Feb 23, 2026Updated 5 months ago
Alternatives and similar repositories for video-SALMONN-2
Users that are interested in video-SALMONN-2 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This is the official repository of Daily-Omni: Towards Audio-Visual Reasoning with Temporal Alignment across Modalities☆42Apr 28, 2026Updated 2 months ago
- https://avocado-captioner.github.io/☆37Oct 16, 2025Updated 9 months ago
- [ICML 2026] Scripting Multi-Scene Videos with Time-Aware and Structural Audio-Visual Captions☆49Jun 29, 2026Updated 3 weeks ago
- LongVALE: Vision-Audio-Language-Event Benchmark Towards Time-Aware Omni-Modal Perception of Long Videos. (CVPR 2025))☆61Jun 9, 2025Updated last year
- ☆40Aug 26, 2025Updated 11 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Structured Video Comprehension of Real-World Shorts☆239Sep 21, 2025Updated 10 months ago
- WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMs☆50Jul 12, 2026Updated last week
- ICLR 2026 Oral: WAVE: Learning Unified & Versatile Audio-Visual Embeddings with Multimodal LLM☆40Updated this week
- ☆35Jul 9, 2025Updated last year
- F-16 is a powerful video large language model (LLM) that perceives high-frame-rate videos, which is developed by the Department of Electr…☆40Jul 3, 2025Updated last year
- [ECCV 2026] Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?☆95Jul 13, 2025Updated last year
- The Source Code for OmniVideoBench @ICLR 2026☆77Feb 12, 2026Updated 5 months ago
- [ACM MM 2025] TimeChat-online: 80% Visual Tokens are Naturally Redundant in Streaming Videos☆132Jun 29, 2026Updated 3 weeks ago
- Dense-Localizing Audio-Visual Events in Untrimmed Videos: A Large-Scale Benchmark and Baseline (CVPR 2023)☆73Jan 4, 2026Updated 6 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The official code of "Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoning"☆102Oct 15, 2025Updated 9 months ago
- Video-R1: Reinforcing Video Reasoning in MLLMs [🔥the first paper to explore R1 for video]☆882Dec 14, 2025Updated 7 months ago
- [CVPR 2025] OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?☆154Jul 24, 2025Updated last year
- [CVPR 2026] TimeLens: Rethinking Video Temporal Grounding with Multimodal LLMs☆162Updated this week
- [CVPR 2026] Wavelet-based Frame Selection by Detecting Semantic Boundary for Long Video Understanding☆32Apr 12, 2026Updated 3 months ago
- D-ORCA: Dialogue-Centric Optimization for Robust Audio-Visual Captioning☆15Feb 11, 2026Updated 5 months ago
- ☆16Jun 23, 2026Updated last month
- [ICLR 2026] Data Pipeline, Models, and Benchmark for Omni-Captioner.☆142Apr 7, 2026Updated 3 months ago
- Streaming Video Instruction Tuning☆83Feb 25, 2026Updated 5 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Official implementation of TalkNCE (ICASSP 2024).☆18Apr 30, 2025Updated last year
- StreamingVLM: Real-Time Understanding for Infinite Video Streams☆1,047Oct 15, 2025Updated 9 months ago
- StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understanding☆167May 16, 2025Updated last year
- [ICCV 2025] LVBench: An Extreme Long Video Understanding Benchmark☆145Jul 9, 2025Updated last year
- ✨✨[CVPR 2025] Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis☆788Dec 8, 2025Updated 7 months ago
- [NeurIPS 2025] Watch and Listen: Understanding Audio-Visual-Speech Moments with Multimodal LLM☆27Feb 10, 2026Updated 5 months ago
- A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.☆178Jan 30, 2025Updated last year
- [NeurIPS 2025 Spotlight] StreamForest: Efficient Online Video Understanding with Persistent Event Memory☆133Nov 4, 2025Updated 8 months ago
- [CVPR 2026] OmniZip: Audio-Guided Dynamic Token Compression for Fast Omnimodal Large Language Models☆100Apr 20, 2026Updated 3 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Official repository of paper "LOVE-R1: Advancing Long Video Understanding with Adaptive Zoom-in Mechanism via Multi-Step Reasoning"☆24Nov 1, 2025Updated 8 months ago
- [ICLR 2026] An official implementation of "STAR-Bench: Probing Deep Spatio-Temporal Reasoning as Audio 4D Intelligence"☆42Apr 19, 2026Updated 3 months ago
- EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning (🔥The Exploration of R1 for General Audio-Vis…☆78Jun 3, 2026Updated last month
- 🔥🔥🔥 Latest Papers, Codes and Datasets on Video-LMM Post-Training☆296Mar 3, 2026Updated 4 months ago
- OmniVinci is an omni-modal LLM for joint understanding of vision, audio, and language.☆674Feb 26, 2026Updated 5 months ago
- [AAAI 26 Demo] Offical repo for CAT-V - Caption Anything in Video: Object-centric Dense Video Captioning with Spatiotemporal Multimodal P…☆68Jan 27, 2026Updated 5 months ago
- Unified Audio-Visual Perception for Multi-Task Video Localization☆33Apr 19, 2024Updated 2 years ago