Alternatives and similar repositories for MMSI

Users that are interested in MMSI are comparing it to the libraries listed below

• rikeilong / Bay-CAT
  [ECCV’24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenario…
  ☆52Updated 8 months ago
• jinxiang-liu / anno-free-AVS
  Official code for WACV 2024 paper, "Annotation-free Audio-Visual Segmentation"
  ☆29Updated 7 months ago
• GenjiB / LAVISH
  Vision Transformers are Parameter-Efficient Audio-Visual Learners
  ☆99Updated last year
• schowdhury671 / meerkat
  ☆28Updated 7 months ago
• alibaba-mmai-research / DiST
  ICCV2023: Disentangling Spatial and Temporal Learning for Efficient Image-to-Video Transfer Learning
  ☆41Updated last year
• JacobChalk / TIM
  Codebase for the paper: "TIM: A Time Interval Machine for Audio-Visual Action Recognition"
  ☆40Updated 6 months ago
• vvvb-github / AVSegFormer
  [AAAI 2024] AVSegFormer: Audio-Visual Segmentation with Transformer
  ☆66Updated 2 months ago
• aspirinone / CATR.github.io
  ☆32Updated last year
• Visual-AI / FROSTER
  The official repository for ICLR2024 paper "FROSTER: Frozen CLIP is a Strong Teacher for Open-Vocabulary Action Recognition"
  ☆79Updated 3 months ago
• GeWu-Lab / Ref-AVS
  The official repo for "Ref-AVS: Refer and Segment Objects in Audio-Visual Scenes", ECCV 2024
  ☆39Updated 5 months ago
• yunyikristy / global_local
  ☆14Updated 3 years ago
• ailab-kyunghee / CM2_DVC
  [CVPR 2024] Do you remember? Dense Video Captioning with Cross-Modal Memory Retrieval
  ☆55Updated 10 months ago
• yuxiaochen1103 / FDT
  ☆61Updated last year
• weijianan1 / NVI
  [ECCV2024] Nonverbal Interaction Detection
  ☆27Updated 6 months ago
• Shahzadnit / EZ-CLIP
  ☆19Updated this week
• ydk122024 / CCIM
  [CVPR2023] Context De-confounded Emotion Recognition
  ☆18Updated last year
• knightyxp / DGL
  [AAAI 2024] DGL: Dynamic Global-Local Prompt Tuning for Text-Video Retrieval.
  ☆41Updated 6 months ago
• NMS05 / Patch-Aligned-Contrastive-Learning
  ☆21Updated last year
• TencentYoutuResearch / HighlightDetection-CLC
  Code for CVPR2023 paper "Collaborative Noisy Label Cleaner: Learning Scene-aware Trailers for Multi-modal Highlight Detection in Movies"
  ☆17Updated 2 years ago
• ByZ0e / Glance-Focus
  This repo contains source code for Glance and Focus: Memory Prompting for Multi-Event Video Question Answering (Accepted in NeurIPS 2023)
  ☆27Updated 10 months ago
• Becomebright / GroundVQA
  Official PyTorch code of GroundVQA (CVPR'24)
  ☆60Updated 8 months ago
• farewellthree / BT-Adapter
  [CVPR 2024] Official PyTorch implementation of the paper "One For All: Video Conversation is Feasible Without Video Instruction Tuning"
  ☆32Updated last year
• bladewaltz1 / PromptSwitch
  ☆30Updated last year
• GeWu-Lab / Generalizable-Audio-Visual-Segmentation
  Official repository of "Prompting Segmentation with Sound is Generalizable Audio-Visual Source Localizer", AAAI 2024
  ☆20Updated last year
• sauradip / MUPPET
  [ Arxiv 2023 ] This repository contains the code for "MUPPET: Multi-Modal Few-Shot Temporal Action Detection"
  ☆15Updated last year
• park-jungin / DualPath
  ☆47Updated 2 years ago
• ExplainableML / AVCA-GZSL
  This repository contains the code for our CVPR 2022 paper on "Audio-visual Generalised Zero-shot Learning with Cross-modal Attention and …
  ☆36Updated 2 years ago
• Xeaver / EmotionCLIP
  [CVPR 2023] Code for "Learning Emotion Representations from Verbal and Nonverbal Communication"
  ☆48Updated 2 months ago
• dmoltisanti / air-cvpr23
  This repository contains the Adverbs in Recipes (AIR) dataset and the code published at the CVPR 23 paper: "Learning Action Changes by Me…
  ☆13Updated last year
• RERV / UniAdapter
  [ICLR2024] The official implementation of paper "UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling", by …
  ☆74Updated last year