Alternatives and similar repositories for Multimodal-Fusion-with-Attention-Bottlenecks

Users that are interested in Multimodal-Fusion-with-Attention-Bottlenecks are comparing it to the libraries listed below

• Xeaver / EmotionCLIP
  [CVPR 2023] Code for "Learning Emotion Representations from Verbal and Nonverbal Communication"
  ☆52Updated 7 months ago
• GeWu-Lab / BML_TPAMI2024
  The repo for "On-the-fly Modulation for Balanced Multimodal Learning", T-PAMI 2024
  ☆18Updated last year
• praveena2j / Cross-Attentional-AV-Fusion
  FG2021: Cross Attentional AV Fusion for Dimensional Emotion Recognition
  ☆32Updated 10 months ago
• praveena2j / JointCrossAttentional-AV-Fusion
  ABAW3 (CVPRW): A Joint Cross-Attention Model for Audio-Visual Fusion in Dimensional Emotion Recognition
  ☆47Updated last year
• OpenNLPLab / MMVAE-AVS
  Multimodal Variational Auto-encoder based Audio-Visual Segmentation [ICCV2023].
  ☆19Updated last year
• brian7685 / Multimodal-Clustering-Network
  ICCV 2021
  ☆33Updated 3 years ago
• GeWu-Lab / OGM-GE_CVPR2022
  The repo for "Balanced Multimodal Learning via On-the-fly Gradient Modulation", CVPR 2022 (ORAL)
  ☆286Updated 2 weeks ago
• yanbeic / CCL
  PyTorch Implementation on Paper [CVPR2021]Distilling Audio-Visual Knowledge by Compositional Contrastive Learning
  ☆89Updated 4 years ago
• mdswyz / IMDer
  An official implementation of "Incomplete Multimodality-Diffused Emotion Recognition" in PyTorch. (NeurIPS 2023)
  ☆56Updated last year
• zeroQiaoba / GCNet
  GCNet, official pytorch implementation of our paper "GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversation"
  ☆91Updated 5 months ago
• Jiaxin-Ye / DepMamba
  [ICASSP 2025] Official PyTorch code for training and inference pipeline for DepMamba: Progressive Fusion Mamba for Multimodal Depression …
  ☆75Updated 6 months ago
• mdswyz / DiCMoR
  An official implementation of "Distribution-Consistent Modal Recovering for Incomplete Multimodal Learning" in PyTorch. (ICCV 2023)
  ☆31Updated 2 years ago
• ZhuoYulang / IF-MMIN
  ☆36Updated last year
• TmacMai / Multimodal-Information-Bottleneck
  Multimodal Information Bottleneck: Learning Minimal Sufficient Unimodal and Multimodal Representations (MIB for multimodal sentiment anal…
  ☆80Updated 2 years ago
• AIM3-RUC / MMIN
  Missing Modality Imagination Network for Emotion Recognition with Uncertain Missing Modalities
  ☆69Updated 2 years ago
• deep-real / SMIL
  Pytorch implementation of SMIL: Multimodal Learning with Severely Missing Modality (AAAI 2021)
  ☆112Updated 3 years ago
• GenjiB / LAVISH
  Vision Transformers are Parameter-Efficient Audio-Visual Learners
  ☆103Updated 2 years ago
• mdswyz / DMD
  An official implementation of "Decoupled Multimodal Distilling for Emotion Recognition" in PyTorch. (CVPR 2023 highlight)
  ☆132Updated 2 years ago
• weiguoPian / AV-CIL_ICCV2023
  ☆28Updated last year
• smartcameras / SelfCrossAttn
  PyTorch implementation of the models described in the IEEE ICASSP 2022 paper "Is cross-attention preferable to self-attention for multi-m…
  ☆61Updated 6 months ago
• marmot-xy / CMBS
  cross modal background suppression for audio-visual event localization
  ☆36Updated 3 years ago
• kniter1 / TAILOR
  Pytorch implementation for Tailor Versatile Multi-modal Learning for Multi-label Emotion Recognition
  ☆63Updated 2 years ago
• fanyunfeng-bit / Modal-Imbalance-PMR
  PMR: Prototypical Modal Rebalance for Multimodal Learning
  ☆41Updated 2 years ago
• stoneMo / DeepAVFusion
  Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".
  ☆33Updated last year
• njustkmg / NeurIPS24-LFM
  ☆15Updated 8 months ago
• pritamqu / XKD
  [AAAI 2024] XKD: Cross-modal Knowledge Distillation with Domain Alignment for Video Representation Learning.
  ☆14Updated last year
• anita-hu / MSAF
  Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"
  ☆82Updated 4 years ago
• shicaiwei123 / ECCV2024-DMRNet
  Code for dmrnet
  ☆28Updated 2 months ago
• GeWu-Lab / Certifiable-Robust-Multi-modal-Training
  A python implement for Certifiable Robust Multi-modal Training
  ☆18Updated 3 months ago
• Eurus-Holmes / MulT
  [Reproduce] Code for the ACL2019 paper "Multimodal Transformer for Unaligned Multimodal Language Sequences".
  ☆28Updated 5 years ago