Alternatives and similar repositories for MMSI

Users that are interested in MMSI are comparing it to the libraries listed below

• rikeilong / Bay-CAT
  [ECCV’24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenario…
  ☆57Updated last year
• GenjiB / LAVISH
  Vision Transformers are Parameter-Efficient Audio-Visual Learners
  ☆107Updated 2 years ago
• JacobChalk / TIM
  Codebase for the paper: "TIM: A Time Interval Machine for Audio-Visual Action Recognition"
  ☆48Updated last year
• jinxiang-liu / anno-free-AVS
  Official code for WACV 2024 paper, "Annotation-free Audio-Visual Segmentation"
  ☆35Updated last year
• schowdhury671 / meerkat
  ☆34Updated 5 months ago
• vvvb-github / AVSegFormer
  [AAAI 2024] AVSegFormer: Audio-Visual Segmentation with Transformer
  ☆71Updated 9 months ago
• Xeaver / EmotionCLIP
  [CVPR 2023] Code for "Learning Emotion Representations from Verbal and Nonverbal Communication"
  ☆54Updated 9 months ago
• ttgeng233 / UnAV
  Dense-Localizing Audio-Visual Events in Untrimmed Videos: A Large-Scale Benchmark and Baseline (CVPR 2023)
  ☆69Updated last year
• jasongief / OV-AVEL
  [2025 CVPR] Towards Open-Vocabulary Audio-Visual Event Localization
  ☆37Updated 9 months ago
• GeWu-Lab / TSPM
  Official repository for "Boosting Audio Visual Question Answering via Key Semantic-Aware Cues" in ACM MM 2024.
  ☆16Updated last year
• TencentYoutuResearch / HighlightDetection-CLC
  Code for CVPR2023 paper "Collaborative Noisy Label Cleaner: Learning Scene-aware Trailers for Multi-modal Highlight Detection in Movies"
  ☆18Updated 2 years ago
• AIM-SKKU / QA-TIGER
  Question-Aware Gaussian Experts for Audio-Visual Question Answering -- Official Pytorch Implementation (CVPR'25, Highlight)
  ☆25Updated 6 months ago
• ailab-kyunghee / CM2_DVC
  [CVPR 2024] Do you remember? Dense Video Captioning with Cross-Modal Memory Retrieval
  ☆63Updated last year
• GeWu-Lab / Ref-AVS
  The official repo for "Ref-AVS: Refer and Segment Objects in Audio-Visual Scenes", ECCV 2024
  ☆47Updated last month
• Visual-AI / FROSTER
  [ICLR 2024] FROSTER: Frozen CLIP is a Strong Teacher for Open-Vocabulary Action Recognition
  ☆92Updated 10 months ago
• aimmemotion / EmoVIT
  [CVPR 2024] EmoVIT: Revolutionizing Emotion Insights with Visual Instruction Tuning
  ☆38Updated 7 months ago
• stoneMo / DeepAVFusion
  Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".
  ☆36Updated last year
• BolinLai / CSTS
  [ECCV2024] The official implementation of "Listen to Look into the Future: Audio-Visual Egocentric Gaze Anticipation".
  ☆13Updated 9 months ago
• alibaba-mmai-research / DiST
  ICCV2023: Disentangling Spatial and Temporal Learning for Efficient Image-to-Video Transfer Learning
  ☆41Updated 2 years ago
• yunyikristy / global_local
  ☆14Updated 4 years ago
• j-min / HiREST
  Hierarchical Video-Moment Retrieval and Step-Captioning (CVPR 2023)
  ☆107Updated 10 months ago
• ExplainableML / AVCA-GZSL
  This repository contains the code for our CVPR 2022 paper on "Audio-visual Generalised Zero-shot Learning with Cross-modal Attention and …
  ☆41Updated 3 years ago
• KHU-VLL / CAST
  [NeurIPS 2023] Official implementation of the paper "CAST: Cross-Attention in Space and Time for Video Action Recognition"
  ☆56Updated last year
• jinhyunj / EaTR
  Official pytorch repository for "Knowing Where to Focus: Event-aware Transformer for Video Grounding" (ICCV 2023)
  ☆53Updated 2 years ago
• MRHiSum / MR.HiSum
  ☆45Updated last year
• haoyi-duan / DG-SCT
  NeurIPS'2023 official implementation code
  ☆68Updated 2 years ago
• nku-zhichengzhang / TSL300
  [ACM MM 2022] This is the official implementation of "Temporal Sentiment Localization: Listen and Look in Untrimmed Videos"
  ☆17Updated 9 months ago
• fyyCS / LSLD
  ☆14Updated 2 years ago
• shvdiwnkozbw / Self-supervised-Video-Concept
  Code for Static and Dynamic Concepts for Self-supervised Video Representation Learning.
  ☆11Updated 3 years ago
• aspirinone / CATR.github.io
  ☆31Updated last year