NMS05 / Multimodal-Fusion-with-Attention-BottlenecksLinks
☆35Updated 11 months ago
Alternatives and similar repositories for Multimodal-Fusion-with-Attention-Bottlenecks
Users that are interested in Multimodal-Fusion-with-Attention-Bottlenecks are comparing it to the libraries listed below
Sorting:
- The repo for "On-the-fly Modulation for Balanced Multimodal Learning", T-PAMI 2024☆18Updated last year
- [CVPR 2023] Code for "Learning Emotion Representations from Verbal and Nonverbal Communication"☆53Updated 9 months ago
- FG2021: Cross Attentional AV Fusion for Dimensional Emotion Recognition☆33Updated 11 months ago
- ABAW3 (CVPRW): A Joint Cross-Attention Model for Audio-Visual Fusion in Dimensional Emotion Recognition☆48Updated last year
- An official implementation of "Distribution-Consistent Modal Recovering for Incomplete Multimodal Learning" in PyTorch. (ICCV 2023)☆33Updated 2 years ago
- Pytorch implementation of SMIL: Multimodal Learning with Severely Missing Modality (AAAI 2021)☆115Updated 3 years ago
- Multimodal Variational Auto-encoder based Audio-Visual Segmentation [ICCV2023].☆20Updated last year
- The repo for "Balanced Multimodal Learning via On-the-fly Gradient Modulation", CVPR 2022 (ORAL)☆295Updated last month
- ☆36Updated last year
- GCNet, official pytorch implementation of our paper "GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversation"☆92Updated 6 months ago
- Missing Modality Imagination Network for Emotion Recognition with Uncertain Missing Modalities☆70Updated 3 years ago
- [ICASSP 2025] Official PyTorch code for training and inference pipeline for DepMamba: Progressive Fusion Mamba for Multimodal Depression …☆82Updated 8 months ago
- PyTorch implementation of the models described in the IEEE ICASSP 2022 paper "Is cross-attention preferable to self-attention for multi-m…☆62Updated 7 months ago
- An official implementation of "Decoupled Multimodal Distilling for Emotion Recognition" in PyTorch. (CVPR 2023 highlight)☆141Updated 2 years ago
- PMR: Prototypical Modal Rebalance for Multimodal Learning☆42Updated 2 years ago
- A survey of deep multimodal emotion recognition.☆54Updated 3 years ago
- An official implementation of "Incomplete Multimodality-Diffused Emotion Recognition" in PyTorch. (NeurIPS 2023)☆59Updated last year
- ☆18Updated 9 months ago
- ☆38Updated last year
- Multimodal Information Bottleneck: Learning Minimal Sufficient Unimodal and Multimodal Representations (MIB for multimodal sentiment anal…☆83Updated 2 years ago
- cross modal background suppression for audio-visual event localization☆36Updated 3 years ago
- PyTorch Implementation on Paper [CVPR2021]Distilling Audio-Visual Knowledge by Compositional Contrastive Learning☆89Updated 4 years ago
- Vision Transformers are Parameter-Efficient Audio-Visual Learners☆106Updated 2 years ago
- Pytorch implementation for Tailor Versatile Multi-modal Learning for Multi-label Emotion Recognition☆64Updated 3 years ago
- Mitigating Inconsistencies in Multimodal Sentiment Analysis under Uncertain Missing Modalities, in EMNLP2022☆25Updated 3 years ago
- [AAAI 2024] XKD: Cross-modal Knowledge Distillation with Domain Alignment for Video Representation Learning.☆14Updated last year
- Code for dmrnet☆29Updated 4 months ago
- The implementation of CubeMLP☆48Updated 2 years ago
- A python implement for Certifiable Robust Multi-modal Training☆18Updated 4 months ago
- Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"☆82Updated 4 years ago