GeWu-Lab / OGM-GE_CVPR2022
The repo for "Balanced Multimodal Learning via On-the-fly Gradient Modulation", CVPR 2022 (ORAL)
☆256Updated last month
Alternatives and similar repositories for OGM-GE_CVPR2022:
Users that are interested in OGM-GE_CVPR2022 are comparing it to the libraries listed below
- Multimodal Prompting with Missing Modalities for Visual Recognition, CVPR'23☆193Updated last year
- PMR: Prototypical Modal Rebalance for Multimodal Learning☆36Updated last year
- Multimodal Learning Method MLA for CVPR 2024☆76Updated 8 months ago
- Code for the paper 'Dynamic Multimodal Fusion'☆105Updated last year
- An official implementation of "Decoupled Multimodal Distilling for Emotion Recognition" in PyTorch. (CVPR 2023 highlight)☆107Updated last year
- An official implementation of "Incomplete Multimodality-Diffused Emotion Recognition" in PyTorch. (NeurIPS 2023)☆47Updated last year
- Pytorch implementation of SMIL: Multimodal Learning with Severely Missing Modality (AAAI 2021)☆98Updated 2 years ago
- A curated list of balanced multimodal learning methods.☆48Updated 2 months ago
- The repo for "Enhancing Multi-modal Cooperation via Sample-level Modality Valuation", CVPR 2024☆47Updated 3 months ago
- Multimodal Information Bottleneck: Learning Minimal Sufficient Unimodal and Multimodal Representations (MIB for multimodal sentiment anal…☆62Updated last year
- The repo for "MMPareto: Boosting Multimodal Learning with Innocent Unimodal Assistance", ICML 2024☆39Updated 8 months ago
- Code for UniS-MMC: Multimodal Classification via Unimodality-supervised Multimodal Contrastive Learning (ACL 2023)☆33Updated 9 months ago
- Quality-aware multimodal fusion on ICML 2023☆90Updated 3 months ago
- [NeurIPS 2022] Implementation of "AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognition"☆342Updated 2 years ago
- ☆17Updated 5 months ago
- Code for dmrnet☆21Updated this week
- An official implementation of "Distribution-Consistent Modal Recovering for Incomplete Multimodal Learning" in PyTorch. (ICCV 2023)☆30Updated last year
- Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"☆79Updated 3 years ago
- A python implement for Certifiable Robust Multi-modal Training☆17Updated 7 months ago
- [ICLR'23] AIM: Adapting Image Models for Efficient Video Action Recognition☆286Updated last year
- Source code of ECCV2022 LAFF for Text-to-Video Retrieval☆44Updated last year
- Pytorch implementation for Tailor Versatile Multi-modal Learning for Multi-label Emotion Recognition☆56Updated 2 years ago
- MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysis☆218Updated last year
- GCNet, official pytorch implementation of our paper "GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversation"☆76Updated last year
- The implementation of CubeMLP☆42Updated last year
- Code for "Leveraging Knowledge of Modality Experts for Incomplete Multimodal Learning" accepted by ACM Multimedia 2024☆24Updated last month
- ☆67Updated last year
- Missing Modality Imagination Network for Emotion Recognition with Uncertain Missing Modalities☆62Updated 2 years ago
- ☆16Updated 4 months ago
- Towards Robust Multimodal Sentiment Analysis with Incomplete Data☆47Updated 2 months ago