taco-group / DecAlignLinks
A novel cross-modal decoupling and alignment framework for multimodal representation learning.
☆32Updated 6 months ago
Alternatives and similar repositories for DecAlign
Users that are interested in DecAlign are comparing it to the libraries listed below
Sorting:
- Quality-aware multimodal fusion on ICML 2023☆110Updated 2 months ago
- Code for UniS-MMC: Multimodal Classification via Unimodality-supervised Multimodal Contrastive Learning (ACL 2023)☆36Updated last year
- An official implementation of "Incomplete Multimodality-Diffused Emotion Recognition" in PyTorch. (NeurIPS 2023)☆55Updated last year
- The repo for "Enhancing Multi-modal Cooperation via Sample-level Modality Valuation", CVPR 2024☆54Updated 10 months ago
- Deep Correlated Prompting for Visual Recognition with Missing Modalities (NeurIPS 2024)☆29Updated 6 months ago
- An official implementation of "Distribution-Consistent Modal Recovering for Incomplete Multimodal Learning" in PyTorch. (ICCV 2023)☆31Updated last year
- Code for dmrnet☆26Updated 2 months ago
- ☆49Updated 8 months ago
- A curated list of balanced multimodal learning methods.☆100Updated this week
- The repo for "On-the-fly Modulation for Balanced Multimodal Learning", T-PAMI 2024☆17Updated 11 months ago
- Code for "Leveraging Knowledge of Modality Experts for Incomplete Multimodal Learning" accepted by ACM Multimedia 2024☆32Updated 8 months ago
- ☆14Updated 8 months ago
- The repo for "MMPareto: Boosting Multimodal Learning with Innocent Unimodal Assistance", ICML 2024☆45Updated last year
- Multimodal Prompting with Missing Modalities for Visual Recognition, CVPR'23☆217Updated last year
- Code for the paper 'Dynamic Multimodal Fusion'☆114Updated 2 years ago
- ☆20Updated 5 months ago
- [ICML 2024] Official implementation for "Predictive Dynamic Fusion."☆63Updated 8 months ago
- [CVPR 2024] FairCLIP: Harnessing Fairness in Vision-Language Learning☆89Updated 2 months ago
- ICML2024-ReconBoost: Boosting Can Achieve Modality Reconcilement☆25Updated 4 months ago
- PMR: Prototypical Modal Rebalance for Multimodal Learning☆40Updated 2 years ago
- Pytorch implementation of "Test-time Adaption against Multi-modal Reliability Bias".☆39Updated 8 months ago
- Code and Dataset for the paper "LAMM: Label Alignment for Multi-Modal Prompt Learning" AAAI 2024☆33Updated last year
- Code for the paper Visual Explanations of Image–Text Representations via Multi-Modal Information Bottleneck Attribution☆57Updated last year
- Adaptation of vision-language models (CLIP) to downstream tasks using local and global prompts.☆48Updated 2 months ago
- AAAI-24 Decoupled Contrastive Learning for Long-Tailed Recognition☆32Updated last year
- This repo is the official implementation of "Retrieval-Augmented Dynamic Prompt Tuning for Incomplete Multimodal Learning" accepted by AA…☆47Updated 2 weeks ago
- GCNet, official pytorch implementation of our paper "GCNet: Graph Completion Network for Incomplete Multimodal Learning in Conversation"☆90Updated 4 months ago
- DrFuse: Learning Disentangled Representation for Clinical Multi-Modal Fusion with Missing Modality and Modal Inconsistency (AAAI24)☆56Updated last year
- ☆35Updated 5 months ago
- [AAAI 2025] Enhance Vision-Language Alignment with Noise☆24Updated 9 months ago