Alternatives and similar repositories for MMSI:

Users that are interested in MMSI are comparing it to the libraries listed below

• rikeilong / Bay-CAT
  [ECCV’24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenario…
  ☆48Updated 5 months ago
• jinxiang-liu / anno-free-AVS
  Official code for WACV 2024 paper, "Annotation-free Audio-Visual Segmentation"
  ☆28Updated 4 months ago
• GenjiB / LAVISH
  Vision Transformers are Parameter-Efficient Audio-Visual Learners
  ☆97Updated last year
• vvvb-github / AVSegFormer
  [AAAI 2024] AVSegFormer: Audio-Visual Segmentation with Transformer
  ☆62Updated last month
• enyac-group / T-VSL
  ☆12Updated 8 months ago
• ydk122024 / CCIM
  [CVPR2023] Context De-confounded Emotion Recognition
  ☆18Updated last year
• VUT-HFUT / Micro-Action
  [TCSVT 2024] Official implementation of the paper: Benchmarking Micro-action Recognition: Dataset, Methods, and Applications
  ☆18Updated this week
• schowdhury671 / meerkat
  ☆25Updated 4 months ago
• stoneMo / DeepAVFusion
  Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".
  ☆28Updated 6 months ago
• aspirinone / CATR.github.io
  ☆32Updated 11 months ago
• Xeaver / EmotionCLIP
  [CVPR 2023] Code for "Learning Emotion Representations from Verbal and Nonverbal Communication"
  ☆45Updated this week
• GeWu-Lab / Generalizable-Audio-Visual-Segmentation
  Official repository of "Prompting Segmentation with Sound is Generalizable Audio-Visual Source Localizer", AAAI 2024
  ☆17Updated 10 months ago
• JacobChalk / TIM
  Codebase for the paper: "TIM: A Time Interval Machine for Audio-Visual Action Recognition"
  ☆39Updated 3 months ago
• knightyxp / DGL
  [AAAI 2024] DGL: Dynamic Global-Local Prompt Tuning for Text-Video Retrieval.
  ☆36Updated 4 months ago
• GeWu-Lab / Ref-AVS
  The official repo for "Ref-AVS: Refer and Segment Objects in Audio-Visual Scenes", ECCV 2024
  ☆31Updated 2 months ago
• GeWu-Lab / Stepping-Stones
  The official repo for "Stepping Stones: A Progressive Training Strategy for Audio-Visual Semantic Segmentation", ECCV 2024
  ☆12Updated 4 months ago
• aimmemotion / EmoVIT
  [CVPR 2024] EmoVIT: Revolutionizing Emotion Insights with Visual Instruction Tuning
  ☆24Updated 5 months ago
• haoyi-duan / DG-SCT
  NeurIPS'2023 official implementation code
  ☆59Updated last year
• Lzq5 / Video-Text-Alignment
  ☆23Updated 4 months ago
• Becomebright / GroundVQA
  Official PyTorch code of "Grounded Question-Answering in Long Egocentric Videos", accepted by CVPR 2024.
  ☆56Updated 5 months ago
• ExplainableML / AVCA-GZSL
  This repository contains the code for our CVPR 2022 paper on "Audio-visual Generalised Zero-shot Learning with Cross-modal Attention and …
  ☆35Updated 2 years ago
• fyyCS / LSLD
  ☆14Updated last year
• ByZ0e / Glance-Focus
  This repo contains source code for Glance and Focus: Memory Prompting for Multi-Event Video Question Answering (Accepted in NeurIPS 2023)
  ☆25Updated 7 months ago
• JackYFL / EmoLA
  The official implementation of ECCV2024 paper "Facial Affective Behavior Analysis with Instruction Tuning"
  ☆23Updated last month
• ttgeng233 / UnAV
  Dense-Localizing Audio-Visual Events in Untrimmed Videos: A Large-Scale Benchmark and Baseline (CVPR 2023)
  ☆62Updated last year
• GeWu-Lab / TSPM
  Official repository for "Boosting Audio Visual Question Answering via Key Semantic-Aware Cues" in ACM MM 2024.
  ☆14Updated 3 months ago
• TencentYoutuResearch / HighlightDetection-CLC
  Code for CVPR2023 paper "Collaborative Noisy Label Cleaner: Learning Scene-aware Trailers for Multi-modal Highlight Detection in Movies"
  ☆17Updated last year
• Visual-AI / FROSTER
  The official repository for ICLR2024 paper "FROSTER: Frozen CLIP is a Strong Teacher for Open-Vocabulary Action Recognition"
  ☆69Updated last month
• yunyikristy / global_local
  ☆14Updated 3 years ago
• svip-lab / WeakSVR
  (CVPR 2023) Official implemention of the paper "Weakly Supervised Video Representation Learning with Unaligned Text for Sequential Videos…
  ☆29Updated 10 months ago