Alternatives and similar repositories for video-SALMONN-2

Users that are interested in video-SALMONN-2 are comparing it to the libraries listed below

• EvolvingLMMs-Lab / Aero-1
  ☆78Updated 6 months ago
• hyc2026 / StoryTeller
  ☆79Updated 8 months ago
• BriansIDP / video-SALMONN-o1
  ☆37Updated 2 months ago
• emova-ollm / EMOVA
  Official PyTorch implementation of EMOVA in CVPR 2025 (https://arxiv.org/abs/2409.18042)
  ☆74Updated 8 months ago
• bytedance / vidi
  The official repo for "Vidi: Large Multimodal Models for Video Understanding and Editing"
  ☆144Updated 2 months ago
• HumanMLLM / ViSpeak
  (ICCV2025) Official repository of paper "ViSpeak: Visual Instruction Feedback in Streaming Videos"
  ☆40Updated 4 months ago
• Mark12Ding / Dispider
  [CVPR 2025]Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reaction
  ☆144Updated 7 months ago
• RainBowLuoCS / OpenOmni
  (NIPS 2025) OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Align…
  ☆109Updated last week
• SCZwangxiao / video-FlexReduc
  Official implementation of paper AdaReTaKe: Adaptive Redundancy Reduction to Perceive Longer for Video-language Understanding
  ☆88Updated 6 months ago
• TencentARC / MindOmni
  ☆132Updated last month
• InternLM / StarBench
  ☆30Updated last week
• klingfoley / Kling-Foley
  Kling-Foley: Multimodal Diffusion Transformer for High-Quality Video-to-Audio Generation
  ☆61Updated 4 months ago
• FrankYang-17 / MME-VideoOCR
  ☆35Updated 5 months ago
• qishisuren123 / AnyCap
  A unified framework for controllable caption generation across images, videos, and audio. Supports multi-modal inputs and customizable ca…
  ☆52Updated 3 months ago
• HumanMLLM / HumanOmniV2
  ☆137Updated 3 months ago
• inclusionAI / Ming
  Ming - facilitating advanced multimodal understanding and generation capabilities built upon the Ling LLM.
  ☆534Updated 2 weeks ago
• bytedance / Shot2Story
  A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.
  ☆157Updated 9 months ago
• rese1f / aurora
  [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark
  ☆130Updated 5 months ago
• TencentARC / ARC-Hunyuan-Video-7B
  Structured Video Comprehension of Real-World Shorts
  ☆215Updated last month
• fudoki-hku / FUDOKI
  The author's implementation of FUDOKI, a multimodal large language model purely based on discrete flow matching.
  ☆62Updated 2 months ago
• multimodal-art-projection / OmniBench
  A project for tri-modal LLM benchmarking and instruction tuning.
  ☆50Updated 7 months ago
• Gen-Verse / HermesFlow
  [NeurIPS 2025] HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generation
  ☆71Updated last month
• yzxing87 / Seeing-and-Hearing
  [CVPR 2024] Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners
  ☆150Updated last year
• zh460045050 / VQGAN-LC
  ☆139Updated last year
• litwellchi / MMTrail
  [Arxiv 2024] Official code for MMTrail: A Multimodal Trailer Video Dataset with Language and Music Descriptions
  ☆33Updated 9 months ago
• jacklishufan / OmniFlows
  The official implementation of OmniFlow: Any-to-Any Generation with Multi-Modal Rectified Flows
  ☆119Updated 3 months ago
• EvolvingLMMs-Lab / VideoMMMU
  ☆61Updated 2 months ago
• 360CVGroup / Inner-Adaptor-Architecture
  LMM solved catastrophic forgetting, AAAI2025
  ☆44Updated 7 months ago
• InternLM / CapRL
  An official implementation of "CapRL: Stimulating Dense Image Caption Capabilities via Reinforcement Learning"
  ☆140Updated last week
• invictus717 / MiCo
  [ICCV 2025] Explore the Limits of Omni-modal Pretraining at Scale
  ☆118Updated last year