video-SALMONN 2 is a powerful audio-visual large language model (LLM) that generates high-quality audio-visual video captions, which is developed by the Department of Electronic Engineering at Tsinghua University and ByteDance.
☆223Sep 2, 2026Updated 2 months ago
Alternatives and similar repositories for video-SALMONN-2
Users that are interested in video-SALMONN-2 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This is the official repository of Daily-Omni: Towards Audio-Visual Reasoning with Temporal Alignment across Modalities☆54Oct 26, 2026Updated last week
- https://avocado-captioner.github.io/☆41Oct 16, 2025Updated last year
- [ICML 2026] Scripting Multi-Scene Videos with Time-Aware and Structural Audio-Visual Captions☆62Jun 29, 2026Updated 4 months ago
- LongVALE: Vision-Audio-Language-Event Benchmark Towards Time-Aware Omni-Modal Perception of Long Videos. (CVPR 2025))☆65Jun 9, 2025Updated last year
- ☆40Aug 26, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Structured Video Comprehension of Real-World Shorts☆244Sep 21, 2025Updated last year
- WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMs☆51Jul 12, 2026Updated 3 months ago
- [ECCV 2026] Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?☆101Jul 13, 2025Updated last year
- F-16 is a powerful video large language model (LLM) that perceives high-frame-rate videos, which is developed by the Department of Electr…☆44Jul 3, 2025Updated last year
- ICLR 2026 Oral: WAVE: Learning Unified & Versatile Audio-Visual Embeddings with Multimodal LLM☆53Jul 30, 2026Updated 3 months ago
- ☆36Jul 9, 2025Updated last year
- ✨✨[CVPR 2025] Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis☆803Dec 8, 2025Updated 10 months ago
- SALMONN family: A suite of advanced multi-modal LLMs☆1,564Oct 16, 2026Updated 2 weeks ago
- ✨✨The Curse of Multi-Modalities (CMM): Evaluating Hallucinations of Large Multimodal Models across Language, Visual, and Audio☆55Jul 11, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understanding☆187May 16, 2025Updated last year
- The Source Code for OmniVideoBench @ICLR 2026☆80Feb 12, 2026Updated 8 months ago
- [ACM MM 2025] TimeChat-online: 80% Visual Tokens are Naturally Redundant in Streaming Videos☆135Jun 29, 2026Updated 4 months ago
- Video-R1: Reinforcing Video Reasoning in MLLMs [🔥the first paper to explore R1 for video]☆897Dec 14, 2025Updated 10 months ago
- The official code of "Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoning"☆104Oct 15, 2025Updated last year
- [ICLR 2026] Data Pipeline, Models, and Benchmark for Omni-Captioner.☆146Apr 7, 2026Updated 6 months ago
- [CVPR 2025] OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?☆173Jul 24, 2025Updated last year
- Dense-Localizing Audio-Visual Events in Untrimmed Videos: A Large-Scale Benchmark and Baseline (CVPR 2023)☆73Jan 4, 2026Updated 10 months ago
- A method for multi-reference image-grounded video captioning.☆20Aug 1, 2026Updated 3 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.☆181Jan 30, 2025Updated last year
- Frontier Multimodal Foundation Models for Image and Video Understanding☆1,190Aug 14, 2025Updated last year
- D-ORCA: Dialogue-Centric Optimization for Robust Audio-Visual Captioning☆15Aug 4, 2026Updated 3 months ago
- OmniPro: A Comprehensive Benchmark for Omni-Proactive Streaming Video Understanding☆19Jul 27, 2026Updated 3 months ago
- ☆16Oct 24, 2026Updated last week
- [CVPR 2026] Wavelet-based Frame Selection by Detecting Semantic Boundary for Long Video Understanding☆35Apr 12, 2026Updated 6 months ago
- OmniVinci is an omni-modal LLM for joint understanding of vision, audio, and language.☆685Aug 31, 2026Updated 2 months ago
- EchoInk-R1: Exploring Audio-Visual Reasoning in Multimodal LLMs via Reinforcement Learning (🔥The Exploration of R1 for General Audio-Vis…☆80Jun 3, 2026Updated 5 months ago
- [CVPR 2026] TimeLens: Rethinking Video Temporal Grounding with Multimodal LLMs☆186Oct 29, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆196Feb 8, 2025Updated last year
- ☆166Jul 31, 2025Updated last year
- Streaming Video Instruction Tuning☆95Feb 25, 2026Updated 8 months ago
- [CVPR 2026 highlight] Official release of EgoAVU Egocentric Audio-Visual Understanding☆36Jun 8, 2026Updated 4 months ago
- [CVPR 2026] OmniZip: Audio-Guided Dynamic Token Compression for Fast Omnimodal Large Language Models☆109Apr 20, 2026Updated 6 months ago
- [NeurIPS 2025 Spotlight] StreamForest: Efficient Online Video Understanding with Persistent Event Memory☆136Nov 4, 2025Updated last year
- StreamingVLM: Real-Time Understanding for Infinite Video Streams☆1,107Oct 15, 2025Updated last year