Alternatives and similar repositories for MMSI:

Users that are interested in MMSI are comparing it to the libraries listed below

• rikeilong / Bay-CAT
  [ECCV’24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenario…
  ☆52Updated 7 months ago
• jinxiang-liu / anno-free-AVS
  Official code for WACV 2024 paper, "Annotation-free Audio-Visual Segmentation"
  ☆29Updated 6 months ago
• schowdhury671 / meerkat
  ☆27Updated 6 months ago
• Xeaver / EmotionCLIP
  [CVPR 2023] Code for "Learning Emotion Representations from Verbal and Nonverbal Communication"
  ☆47Updated 2 months ago
• weijianan1 / NVI
  [ECCV2024] Nonverbal Interaction Detection
  ☆27Updated 5 months ago
• vvvb-github / AVSegFormer
  [AAAI 2024] AVSegFormer: Audio-Visual Segmentation with Transformer
  ☆63Updated last month
• Visual-AI / FROSTER
  The official repository for ICLR2024 paper "FROSTER: Frozen CLIP is a Strong Teacher for Open-Vocabulary Action Recognition"
  ☆78Updated 3 months ago
• aspirinone / CATR.github.io
  ☆32Updated last year
• ailab-kyunghee / CM2_DVC
  [CVPR 2024] Do you remember? Dense Video Captioning with Cross-Modal Memory Retrieval
  ☆55Updated 10 months ago
• GenjiB / LAVISH
  Vision Transformers are Parameter-Efficient Audio-Visual Learners
  ☆99Updated last year
• alibaba-mmai-research / DiST
  ICCV2023: Disentangling Spatial and Temporal Learning for Efficient Image-to-Video Transfer Learning
  ☆41Updated last year
• GeWu-Lab / Ref-AVS
  The official repo for "Ref-AVS: Refer and Segment Objects in Audio-Visual Scenes", ECCV 2024
  ☆39Updated 4 months ago
• Becomebright / GroundVQA
  Official PyTorch code of GroundVQA (CVPR'24)
  ☆59Updated 7 months ago
• nku-zhichengzhang / TSL300
  [ACM MM 2022] This is the official implementation of "Temporal Sentiment Localization: Listen and Look in Untrimmed Videos"
  ☆16Updated 2 months ago
• aimmemotion / EmoVIT
  [CVPR 2024] EmoVIT: Revolutionizing Emotion Insights with Visual Instruction Tuning
  ☆31Updated this week
• ExplainableML / AVCA-GZSL
  This repository contains the code for our CVPR 2022 paper on "Audio-visual Generalised Zero-shot Learning with Cross-modal Attention and …
  ☆36Updated 2 years ago
• knightyxp / DGL
  [AAAI 2024] DGL: Dynamic Global-Local Prompt Tuning for Text-Video Retrieval.
  ☆41Updated 6 months ago
• yunyikristy / global_local
  ☆14Updated 3 years ago
• enyac-group / T-VSL
  ☆13Updated 10 months ago
• stoneMo / DeepAVFusion
  Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".
  ☆31Updated 8 months ago
• TencentYoutuResearch / HighlightDetection-CLC
  Code for CVPR2023 paper "Collaborative Noisy Label Cleaner: Learning Scene-aware Trailers for Multi-modal Highlight Detection in Movies"
  ☆17Updated 2 years ago
• lxa9867 / QSD
  [CVPR 2024] "Towards Robust Audiovisual Segmentation in Complex Environments with Quantization-based Semantic Decomposition"
  ☆13Updated last year
• ut-vision / ActionVOS
  [ECCV 2024 Oral] ActionVOS: Actions as Prompts for Video Object Segmentation
  ☆31Updated 4 months ago
• GeWu-Lab / TSPM
  Official repository for "Boosting Audio Visual Question Answering via Key Semantic-Aware Cues" in ACM MM 2024.
  ☆16Updated 5 months ago
• ydk122024 / CCIM
  [CVPR2023] Context De-confounded Emotion Recognition
  ☆18Updated last year
• JacobChalk / TIM
  Codebase for the paper: "TIM: A Time Interval Machine for Audio-Visual Action Recognition"
  ☆39Updated 5 months ago
• stoneMo / CIGN
  Official implementation for CIGN
  ☆15Updated last year
• hrtang22 / MUSE
  Code implementation of paper "MUSE: Mamba is Efficient Multi-scale Learner for Text-video Retrieval (AAAI2025)"
  ☆18Updated 2 months ago
• bladewaltz1 / PromptSwitch
  ☆29Updated last year
• KHU-VLL / CAST
  [NeurIPS 2023] Official implementation of the paper "CAST: Cross-Attention in Space and Time for Video Action Recognition"
  ☆50Updated last year