Alternatives and similar repositories for Multimodal-Fusion-with-Attention-Bottlenecks

Users that are interested in Multimodal-Fusion-with-Attention-Bottlenecks are comparing it to the libraries listed below

• mdswyz / DiCMoR
  An official implementation of "Distribution-Consistent Modal Recovering for Incomplete Multimodal Learning" in PyTorch. (ICCV 2023)
  ☆31Updated last year
• Jiaxin-Ye / DepMamba
  [ICASSP 2025] Official PyTorch code for training and inference pipeline for DepMamba: Progressive Fusion Mamba for Multimodal Depression …
  ☆74Updated 5 months ago
• GeWu-Lab / BML_TPAMI2024
  The repo for "On-the-fly Modulation for Balanced Multimodal Learning", T-PAMI 2024
  ☆17Updated 11 months ago
• praveena2j / Cross-Attentional-AV-Fusion
  FG2021: Cross Attentional AV Fusion for Dimensional Emotion Recognition
  ☆32Updated 9 months ago
• AIM3-RUC / MMIN
  Missing Modality Imagination Network for Emotion Recognition with Uncertain Missing Modalities
  ☆66Updated 2 years ago
• TmacMai / Multimodal-Information-Bottleneck
  Multimodal Information Bottleneck: Learning Minimal Sufficient Unimodal and Multimodal Representations (MIB for multimodal sentiment anal…
  ☆76Updated 2 years ago
• deep-real / SMIL
  Pytorch implementation of SMIL: Multimodal Learning with Severely Missing Modality (AAAI 2021)
  ☆113Updated 3 years ago
• Xeaver / EmotionCLIP
  [CVPR 2023] Code for "Learning Emotion Representations from Verbal and Nonverbal Communication"
  ☆51Updated 6 months ago
• njustkmg / NeurIPS24-LFM
  ☆13Updated 7 months ago
• OpenNLPLab / MMVAE-AVS
  Multimodal Variational Auto-encoder based Audio-Visual Segmentation [ICCV2023].
  ☆19Updated 11 months ago
• yanbeic / CCL
  PyTorch Implementation on Paper [CVPR2021]Distilling Audio-Visual Knowledge by Compositional Contrastive Learning
  ☆89Updated 4 years ago
• GeWu-Lab / OGM-GE_CVPR2022
  The repo for "Balanced Multimodal Learning via On-the-fly Gradient Modulation", CVPR 2022 (ORAL)
  ☆279Updated 7 months ago
• ZhuoYulang / IF-MMIN
  ☆33Updated 11 months ago
• mdswyz / DMD
  An official implementation of "Decoupled Multimodal Distilling for Emotion Recognition" in PyTorch. (CVPR 2023 highlight)
  ☆125Updated 2 years ago
• weiguoPian / AV-CIL_ICCV2023
  ☆28Updated 11 months ago
• smartcameras / SelfCrossAttn
  PyTorch implementation of the models described in the IEEE ICASSP 2022 paper "Is cross-attention preferable to self-attention for multi-m…
  ☆61Updated 5 months ago
• mdswyz / IMDer
  An official implementation of "Incomplete Multimodality-Diffused Emotion Recognition" in PyTorch. (NeurIPS 2023)
  ☆55Updated last year
• praveena2j / JointCrossAttentional-AV-Fusion
  ABAW3 (CVPRW): A Joint Cross-Attention Model for Audio-Visual Fusion in Dimensional Emotion Recognition
  ☆47Updated last year
• brian7685 / Multimodal-Clustering-Network
  ICCV 2021
  ☆33Updated 3 years ago
• zeroQiaoba / GCNet
  GCNet, official pytorch implementation of our paper "GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversation"
  ☆87Updated 3 months ago
• JaydenZeng / EMMR
  Mitigating Inconsistencies in Multimodal Sentiment Analysis under Uncertain Missing Modalities, in EMNLP2022
  ☆25Updated 3 years ago
• mogvision / regbn
  ☆12Updated last year
• kniter1 / TAILOR
  Pytorch implementation for Tailor Versatile Multi-modal Learning for Multi-label Emotion Recognition
  ☆62Updated 2 years ago
• ZhuoYulang / CIF-MMIN
  ☆31Updated last year
• CFM-MSG / Code_URMF
  ☆34Updated 4 months ago
• kiva12138 / MITRL
  Modality-Invariant Temporal Representation Learning
  ☆20Updated 2 years ago
• GenjiB / LAVISH
  Vision Transformers are Parameter-Efficient Audio-Visual Learners
  ☆102Updated 2 years ago
• kiva12138 / CubeMLP
  The implementation of CubeMLP
  ☆47Updated 2 years ago
• stoneMo / DeepAVFusion
  Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".
  ☆33Updated last year
• anita-hu / MSAF
  Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"
  ☆82Updated 4 years ago