taco-group / DecAlignLinks
A novel cross-modal decoupling and alignment framework for multimodal representation learning.
☆36Updated 7 months ago
Alternatives and similar repositories for DecAlign
Users that are interested in DecAlign are comparing it to the libraries listed below
Sorting:
- [ICML 2023] Provable Dynamic Fusion for Low-Quality Multimodal Data☆111Updated 4 months ago
- Code for "Leveraging Knowledge of Modality Experts for Incomplete Multimodal Learning" accepted by ACM Multimedia 2024☆32Updated 9 months ago
- An official implementation of "Distribution-Consistent Modal Recovering for Incomplete Multimodal Learning" in PyTorch. (ICCV 2023)☆31Updated 2 years ago
- Code for UniS-MMC: Multimodal Classification via Unimodality-supervised Multimodal Contrastive Learning (ACL 2023)☆37Updated last year
- An official implementation of "Incomplete Multimodality-Diffused Emotion Recognition" in PyTorch. (NeurIPS 2023)☆58Updated last year
- Code for dmrnet☆28Updated 3 months ago
- Deep Correlated Prompting for Visual Recognition with Missing Modalities (NeurIPS 2024)☆29Updated 7 months ago
- The repo for "Enhancing Multi-modal Cooperation via Sample-level Modality Valuation", CVPR 2024☆57Updated 11 months ago
- The repo for "On-the-fly Modulation for Balanced Multimodal Learning", T-PAMI 2024☆18Updated last year
- ☆52Updated 10 months ago
- [ICML 2024] Official implementation for "Predictive Dynamic Fusion."☆65Updated 9 months ago
- ☆21Updated 6 months ago
- ☆15Updated 9 months ago
- The repo for "MMPareto: Boosting Multimodal Learning with Innocent Unimodal Assistance", ICML 2024☆47Updated last year
- Code for the paper 'Dynamic Multimodal Fusion'☆117Updated 2 years ago
- A curated list of balanced multimodal learning methods.☆125Updated last week
- Multimodal Prompting with Missing Modalities for Visual Recognition, CVPR'23☆219Updated last year
- PMR: Prototypical Modal Rebalance for Multimodal Learning☆42Updated 2 years ago
- DrFuse: Learning Disentangled Representation for Clinical Multi-Modal Fusion with Missing Modality and Modal Inconsistency (AAAI24)☆57Updated last year
- ☆38Updated last year
- A python implement for Certifiable Robust Multi-modal Training☆18Updated 4 months ago
- offical implementation of "Calibrating Multimodal Learning" on ICML 2023☆20Updated 2 years ago
- PyTorch Implementation of Deep Equilibrium Multimodal Fusion☆21Updated 2 years ago
- GCNet, official pytorch implementation of our paper "GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversation"☆92Updated 5 months ago
- ☆36Updated 7 months ago
- The repo for "Diagnosing and Re-learning for Balanced Multi-modal Learning", ECCV 2024☆27Updated last year
- [CVPR'25] EMOE: Modality-Specific Enhanced Dynamic Emotion Experts☆69Updated 3 months ago
- The official code repository of ShaSpec model from CVPR 2023 [paper](https://arxiv.org/pdf/2307.14126) "Multi-modal Learning with Missing…☆77Updated 6 months ago
- [CVPR 2024] FairCLIP: Harnessing Fairness in Vision-Language Learning☆91Updated 3 months ago
- Code for the paper Visual Explanations of Image–Text Representations via Multi-Modal Information Bottleneck Attribution☆60Updated last year