taco-group / DecAlignLinks
A novel cross-modal decoupling and alignment framework for multimodal representation learning.
☆30Updated 5 months ago
Alternatives and similar repositories for DecAlign
Users that are interested in DecAlign are comparing it to the libraries listed below
Sorting:
- Quality-aware multimodal fusion on ICML 2023☆110Updated 2 months ago
- An official implementation of "Incomplete Multimodality-Diffused Emotion Recognition" in PyTorch. (NeurIPS 2023)☆55Updated last year
- Code for UniS-MMC: Multimodal Classification via Unimodality-supervised Multimodal Contrastive Learning (ACL 2023)☆36Updated last year
- Code for dmrnet☆26Updated last month
- An official implementation of "Distribution-Consistent Modal Recovering for Incomplete Multimodal Learning" in PyTorch. (ICCV 2023)☆31Updated last year
- The repo for "Enhancing Multi-modal Cooperation via Sample-level Modality Valuation", CVPR 2024☆55Updated 9 months ago
- The repo for "On-the-fly Modulation for Balanced Multimodal Learning", T-PAMI 2024☆17Updated 11 months ago
- The repo for "MMPareto: Boosting Multimodal Learning with Innocent Unimodal Assistance", ICML 2024☆45Updated last year
- ☆20Updated 4 months ago
- [ICML 2024] Official implementation for "Predictive Dynamic Fusion."☆63Updated 7 months ago
- Deep Correlated Prompting for Visual Recognition with Missing Modalities (NeurIPS 2024)☆27Updated 5 months ago
- ICML2024-ReconBoost: Boosting Can Achieve Modality Reconcilement☆25Updated 3 months ago
- Multimodal Prompting with Missing Modalities for Visual Recognition, CVPR'23☆215Updated last year
- [CVPR 2024] FairCLIP: Harnessing Fairness in Vision-Language Learning☆89Updated last month
- Code for "Leveraging Knowledge of Modality Experts for Incomplete Multimodal Learning" accepted by ACM Multimedia 2024☆31Updated 7 months ago
- ☆13Updated 7 months ago
- ☆47Updated 8 months ago
- Code for the paper 'Dynamic Multimodal Fusion'☆114Updated 2 years ago
- PMR: Prototypical Modal Rebalance for Multimodal Learning☆39Updated 2 years ago
- [ICLR 2024] SemiReward: A General Reward Model for Semi-supervised Learning☆71Updated last year
- Code for the paper Visual Explanations of Image–Text Representations via Multi-Modal Information Bottleneck Attribution☆56Updated last year
- A curated list of balanced multimodal learning methods.☆97Updated last month
- offical implementation of "Calibrating Multimodal Learning" on ICML 2023☆20Updated 2 years ago
- The repo for "Diagnosing and Re-learning for Balanced Multi-modal Learning", ECCV 2024☆26Updated last year
- Pytorch implementation of "Test-time Adaption against Multi-modal Reliability Bias".☆37Updated 8 months ago
- ☆32Updated 9 months ago
- Code and Dataset for the paper "LAMM: Label Alignment for Multi-Modal Prompt Learning" AAAI 2024☆32Updated last year
- Adaptation of vision-language models (CLIP) to downstream tasks using local and global prompts.☆47Updated last month
- GCNet, official pytorch implementation of our paper "GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversation"☆88Updated 3 months ago
- [AAAI 2025] Enhance Vision-Language Alignment with Noise☆24Updated 8 months ago