NMS05 / Multimodal-Fusion-with-Attention-Bottlenecks
☆27Updated 5 months ago
Alternatives and similar repositories for Multimodal-Fusion-with-Attention-Bottlenecks:
Users that are interested in Multimodal-Fusion-with-Attention-Bottlenecks are comparing it to the libraries listed below
- [ICASSP 2025] Official PyTorch code for training and inference pipeline for DepMamba: Progressive Fusion Mamba for Multimodal Depression …☆49Updated last month
- Pytorch implementation of SMIL: Multimodal Learning with Severely Missing Modality (AAAI 2021)☆104Updated 2 years ago
- [CVPR 2023] Code for "Learning Emotion Representations from Verbal and Nonverbal Communication"☆47Updated 2 months ago
- An official implementation of "Distribution-Consistent Modal Recovering for Incomplete Multimodal Learning" in PyTorch. (ICCV 2023)☆31Updated last year
- ☆12Updated 3 months ago
- Multimodal Variational Auto-encoder based Audio-Visual Segmentation [ICCV2023].☆19Updated 7 months ago
- Multimodal Information Bottleneck: Learning Minimal Sufficient Unimodal and Multimodal Representations (MIB for multimodal sentiment anal…☆66Updated 2 years ago
- ABAW3 (CVPRW): A Joint Cross-Attention Model for Audio-Visual Fusion in Dimensional Emotion Recognition☆44Updated last year
- Missing Modality Imagination Network for Emotion Recognition with Uncertain Missing Modalities☆64Updated 2 years ago
- An official implementation of "Decoupled Multimodal Distilling for Emotion Recognition" in PyTorch. (CVPR 2023 highlight)☆110Updated last year
- PyTorch implementation of the models described in the IEEE ICASSP 2022 paper "Is cross-attention preferable to self-attention for multi-m…☆58Updated 3 weeks ago
- FG2021: Cross Attentional AV Fusion for Dimensional Emotion Recognition☆28Updated 4 months ago
- GCNet, official pytorch implementation of our paper "GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversation"☆79Updated last year
- ☆33Updated 7 months ago
- PyTorch Implementation of Deep Equilibrium Multimodal Fusion☆20Updated last year
- The repo for "On-the-fly Modulation for Balanced Multimodal Learning", T-PAMI 2024☆11Updated 6 months ago
- Code for dmrnet☆22Updated 2 months ago
- Pytorch implementation for Tailor Versatile Multi-modal Learning for Multi-label Emotion Recognition☆60Updated 2 years ago
- ☆28Updated 3 weeks ago
- An official implementation of "Incomplete Multimodality-Diffused Emotion Recognition" in PyTorch. (NeurIPS 2023)☆47Updated last year
- ☆29Updated last year
- Code for the paper 'Dynamic Multimodal Fusion'☆106Updated 2 years ago
- Mitigating Inconsistencies in Multimodal Sentiment Analysis under Uncertain Missing Modalities, in EMNLP2022☆26Updated 2 years ago
- Code for "Leveraging Knowledge of Modality Experts for Incomplete Multimodal Learning" accepted by ACM Multimedia 2024☆26Updated 3 months ago
- Modality-Invariant Temporal Representation Learning☆17Updated 2 years ago
- PyTorch implementation of "Multi-modality Associative Bridging through Memory: Speech Sound Recollected from Face Video" (ICCV2021)☆20Updated 3 years ago
- The repo for "MMPareto: Boosting Multimodal Learning with Innocent Unimodal Assistance", ICML 2024☆42Updated 9 months ago
- [AAAI 2024] XKD: Cross-modal Knowledge Distillation with Domain Alignment for Video Representation Learning.☆12Updated 9 months ago
- CrossCLR: Cross-modal Contrastive Learning For Multi-modal Video Representations, ICCV 2021☆63Updated 3 years ago
- PyTorch Implementation on Paper [CVPR2021]Distilling Audio-Visual Knowledge by Compositional Contrastive Learning☆87Updated 3 years ago