The repo for "Balanced Multimodal Learning via On-the-fly Gradient Modulation", CVPR 2022 (ORAL)
☆311Sep 22, 2025Updated 5 months ago
Alternatives and similar repositories for OGM-GE_CVPR2022
Users that are interested in OGM-GE_CVPR2022 are comparing it to the libraries listed below
Sorting:
- The code repo for ICASSP 2023 Paper "MMCosine: Multi-Modal Cosine Loss Towards Balanced Audio-Visual Fine-Grained Learning"☆25May 18, 2023Updated 2 years ago
- A curated list of audio-visual learning methods and datasets.☆286Dec 3, 2024Updated last year
- A curated list of balanced multimodal learning methods.☆159Updated this week
- The repo for "On-the-fly Modulation for Balanced Multimodal Learning", T-PAMI 2024☆19Sep 29, 2024Updated last year
- [ICML 2023] Provable Dynamic Fusion for Low-Quality Multimodal Data☆118Jun 28, 2025Updated 8 months ago
- offical implementation of "Calibrating Multimodal Learning" on ICML 2023☆20Jun 5, 2023Updated 2 years ago
- The repo for "Diagnosing and Re-learning for Balanced Multi-modal Learning", ECCV 2024☆30Jul 30, 2024Updated last year
- The repo for "Enhancing Multi-modal Cooperation via Sample-level Modality Valuation", CVPR 2024☆59Nov 5, 2024Updated last year
- ☆39Feb 23, 2025Updated last year
- A python implement for Certifiable Robust Multi-modal Training☆19Jun 21, 2025Updated 8 months ago
- [NeurIPS 2021] Multiscale Benchmarks for Multimodal Representation Learning☆613Jan 27, 2024Updated 2 years ago
- ICML2024-ReconBoost: Boosting Can Achieve Modality Reconcilement☆28May 2, 2025Updated 10 months ago
- MUSIC-AVQA, CVPR2022 (ORAL)☆96Dec 30, 2022Updated 3 years ago
- Official repository for "Boosting Audio Visual Question Answering via Key Semantic-Aware Cues" in ACM MM 2024.☆16Oct 25, 2024Updated last year
- This is the repo for "Adaptive Unimodal Regulation for Balanced Multimodal Information Acquisition", CVPR2025.☆20Dec 22, 2025Updated 2 months ago
- This is the official code for NeurIPS 2023 paper "Learning Unseen Modality Interaction"☆18Jan 22, 2024Updated 2 years ago
- [ICLR 23 oral] The Modality Focusing Hypothesis: Towards Understanding Crossmodal Knowledge Distillation☆46Jul 10, 2023Updated 2 years ago
- Vision Transformers are Parameter-Efficient Audio-Visual Learners☆106Aug 11, 2023Updated 2 years ago
- ☆54Dec 30, 2024Updated last year
- Reading list for research topics in multimodal machine learning☆6,821Aug 20, 2024Updated last year
- Reliable Conflictive Multi-view Learning☆95Mar 24, 2024Updated last year
- CLUE code☆14May 1, 2025Updated 10 months ago
- ☆17Mar 14, 2023Updated 2 years ago
- ☆26May 8, 2022Updated 3 years ago
- ☆22May 16, 2024Updated last year
- TF-FD☆20Nov 19, 2022Updated 3 years ago
- codes for Neural Architecture Ranker and detailed cell information datasets based on NAS-Bench series☆12Jul 11, 2022Updated 3 years ago
- Code for ICLR 2023 Harnessing Out-Of-Distribution Examples via Augmenting Content and Style☆13Jul 3, 2023Updated 2 years ago
- ☆12Aug 25, 2023Updated 2 years ago
- ☆24Mar 30, 2024Updated last year
- Mitigating Inconsistencies in Multimodal Sentiment Analysis under Uncertain Missing Modalities, in EMNLP2022☆26Jun 21, 2022Updated 3 years ago
- ☆19Jan 21, 2025Updated last year
- SAEval: A benchmark for sentiment analysis to evaluate the model's performance on various subtasks.☆13Apr 29, 2024Updated last year
- ☆18Oct 29, 2022Updated 3 years ago
- [ECCV2022] Motion Sensitive Contrastive Learning for Self-supervised Video Representation☆17Aug 12, 2022Updated 3 years ago
- [ICML 2024] Official implementation for "Predictive Dynamic Fusion."☆70Jan 11, 2025Updated last year
- ICNet: Intra-saliency Correlation Network for Co-Saliency Detection, NeurIPS(2020)☆30Apr 18, 2021Updated 4 years ago
- Can audio-visual integration strengthen robustness under multimodal attacks?☆29Mar 31, 2022Updated 3 years ago
- [NeurIPS 2023, ICMI 2023] Quantifying & Modeling Multimodal Interactions☆86Oct 28, 2024Updated last year