Alternatives and similar repositories for Multimodal-Fusion-with-Attention-Bottlenecks

Users that are interested in Multimodal-Fusion-with-Attention-Bottlenecks are comparing it to the libraries listed below

• Xeaver / EmotionCLIP
  [CVPR 2023] Code for "Learning Emotion Representations from Verbal and Nonverbal Communication"
  ☆51Updated 7 months ago
• GeWu-Lab / BML_TPAMI2024
  The repo for "On-the-fly Modulation for Balanced Multimodal Learning", T-PAMI 2024
  ☆17Updated 11 months ago
• mdswyz / DiCMoR
  An official implementation of "Distribution-Consistent Modal Recovering for Incomplete Multimodal Learning" in PyTorch. (ICCV 2023)
  ☆31Updated last year
• OpenNLPLab / MMVAE-AVS
  Multimodal Variational Auto-encoder based Audio-Visual Segmentation [ICCV2023].
  ☆19Updated last year
• praveena2j / Cross-Attentional-AV-Fusion
  FG2021: Cross Attentional AV Fusion for Dimensional Emotion Recognition
  ☆32Updated 9 months ago
• deep-real / SMIL
  Pytorch implementation of SMIL: Multimodal Learning with Severely Missing Modality (AAAI 2021)
  ☆112Updated 3 years ago
• GeWu-Lab / OGM-GE_CVPR2022
  The repo for "Balanced Multimodal Learning via On-the-fly Gradient Modulation", CVPR 2022 (ORAL)
  ☆282Updated 8 months ago
• praveena2j / JointCrossAttentional-AV-Fusion
  ABAW3 (CVPRW): A Joint Cross-Attention Model for Audio-Visual Fusion in Dimensional Emotion Recognition
  ☆47Updated last year
• Jiaxin-Ye / DepMamba
  [ICASSP 2025] Official PyTorch code for training and inference pipeline for DepMamba: Progressive Fusion Mamba for Multimodal Depression …
  ☆75Updated 6 months ago
• mdswyz / DMD
  An official implementation of "Decoupled Multimodal Distilling for Emotion Recognition" in PyTorch. (CVPR 2023 highlight)
  ☆127Updated 2 years ago
• smartcameras / SelfCrossAttn
  PyTorch implementation of the models described in the IEEE ICASSP 2022 paper "Is cross-attention preferable to self-attention for multi-m…
  ☆61Updated 5 months ago
• GenjiB / LAVISH
  Vision Transformers are Parameter-Efficient Audio-Visual Learners
  ☆103Updated 2 years ago
• njustkmg / NeurIPS24-LFM
  ☆14Updated 7 months ago
• yanbeic / CCL
  PyTorch Implementation on Paper [CVPR2021]Distilling Audio-Visual Knowledge by Compositional Contrastive Learning
  ☆89Updated 4 years ago
• zeroQiaoba / GCNet
  GCNet, official pytorch implementation of our paper "GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversation"
  ☆90Updated 4 months ago
• mdswyz / IMDer
  An official implementation of "Incomplete Multimodality-Diffused Emotion Recognition" in PyTorch. (NeurIPS 2023)
  ☆55Updated last year
• AIM3-RUC / MMIN
  Missing Modality Imagination Network for Emotion Recognition with Uncertain Missing Modalities
  ☆67Updated 2 years ago
• pritamqu / XKD
  [AAAI 2024] XKD: Cross-modal Knowledge Distillation with Domain Alignment for Video Representation Learning.
  ☆14Updated last year
• TmacMai / Multimodal-Information-Bottleneck
  Multimodal Information Bottleneck: Learning Minimal Sufficient Unimodal and Multimodal Representations (MIB for multimodal sentiment anal…
  ☆78Updated 2 years ago
• weiguoPian / AV-CIL_ICCV2023
  ☆28Updated 11 months ago
• GeWu-Lab / MWAFM
  Multi-Scale Attention for Audio Question Answering
  ☆28Updated 2 years ago
• anita-hu / MSAF
  Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"
  ☆82Updated 4 years ago
• stoneMo / DeepAVFusion
  Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".
  ☆33Updated last year
• fanyunfeng-bit / Modal-Imbalance-PMR
  PMR: Prototypical Modal Rebalance for Multimodal Learning
  ☆40Updated 2 years ago
• brian7685 / Multimodal-Clustering-Network
  ICCV 2021
  ☆33Updated 3 years ago
• kniter1 / TAILOR
  Pytorch implementation for Tailor Versatile Multi-modal Learning for Multi-label Emotion Recognition
  ☆62Updated 2 years ago
• xiaobai1217 / Unseen-Modality-Interaction
  This is the official code for NeurIPS 2023 paper "Learning Unseen Modality Interaction"
  ☆16Updated last year
• mogvision / regbn
  ☆12Updated last year
• zihuixue / DynMM
  Code for the paper 'Dynamic Multimodal Fusion'
  ☆114Updated 2 years ago
• ZhuoYulang / IF-MMIN
  ☆33Updated last year