xiaobai1217 / Unseen-Modality-InteractionLinks
This is the official code for NeurIPS 2023 paper "Learning Unseen Modality Interaction"
☆16Updated last year
Alternatives and similar repositories for Unseen-Modality-Interaction
Users that are interested in Unseen-Modality-Interaction are comparing it to the libraries listed below
Sorting:
- The repo for "MMPareto: Boosting Multimodal Learning with Innocent Unimodal Assistance", ICML 2024☆46Updated last year
- Pytorch implementation of "Test-time Adaption against Multi-modal Reliability Bias".☆40Updated 9 months ago
- PMR: Prototypical Modal Rebalance for Multimodal Learning☆41Updated 2 years ago
- The repo for "Enhancing Multi-modal Cooperation via Sample-level Modality Valuation", CVPR 2024☆55Updated 11 months ago
- Code for the paper Visual Explanations of Image–Text Representations via Multi-Modal Information Bottleneck Attribution☆58Updated last year
- Multimodal Prompting with Missing Modalities for Visual Recognition, CVPR'23☆217Updated last year
- offical implementation of "Calibrating Multimodal Learning" on ICML 2023☆20Updated 2 years ago
- [ICLR 23 oral] The Modality Focusing Hypothesis: Towards Understanding Crossmodal Knowledge Distillation☆45Updated 2 years ago
- [ICLR2023] PLOT: Prompt Learning with Optimal Transport for Vision-Language Models☆171Updated last year
- Code for dmrnet☆28Updated 2 months ago
- Adaptation of vision-language models (CLIP) to downstream tasks using local and global prompts.☆48Updated 2 months ago
- ☆50Updated 9 months ago
- ☆54Updated last year
- Learning Hierarchical Prompt with Structured Linguistic Knowledge for Vision-Language Models (AAAI 2024)☆74Updated 8 months ago
- [ICLR 2024] Test-Time Adaptation with CLIP Reward for Zero-Shot Generalization in Vision-Language Models.☆92Updated last year
- ☆101Updated last year
- ☆37Updated 2 years ago
- The official pytorch implemention of our CVPR-2024 paper "MMA: Multi-Modal Adapter for Vision-Language Models".☆82Updated 5 months ago
- [ICCV2023] The repo for "Boosting Multi-modal Model Performance with Adaptive Gradient Modulation".☆26Updated last year
- ☆27Updated 2 years ago
- [CVPR 2024] FairCLIP: Harnessing Fairness in Vision-Language Learning☆89Updated 2 months ago
- [NeurIPS 2023, ICMI 2023] Quantifying & Modeling Multimodal Interactions☆79Updated 11 months ago
- Codebase for "Multimodal Distillation for Egocentric Action Recognition" (ICCV 2023)☆30Updated last year
- This is the official code for the paper "Reconstruct before Query: Continual Missing Modality Learning with Decomposed Prompt Collaborati…☆11Updated last year
- [CVPR 2024] Official Repository for "Efficient Test-Time Adaptation of Vision-Language Models"☆105Updated last year
- Official Implementation of "Read-only Prompt Optimization for Vision-Language Few-shot Learning", ICCV 2023☆54Updated 2 years ago
- The official implementation of CMAE https://arxiv.org/abs/2207.13532 and https://ieeexplore.ieee.org/document/10330745☆109Updated last year
- [NeurIPS 2022] code for the paper, SemMAE: Semantic-guided masking for learning masked autoencoders☆40Updated 2 years ago
- [ICML2024] Official PyTorch implementation of CoMC: Language-Driven Cross-Modal Classifier for Zero-Shot Multi-Label Image Recognition☆15Updated last year
- ☆83Updated 2 years ago