xiaobai1217 / Unseen-Modality-Interaction
This is the official code for NeurIPS 2023 paper "Learning Unseen Modality Interaction"
☆17Updated last year
Alternatives and similar repositories for Unseen-Modality-Interaction:
Users that are interested in Unseen-Modality-Interaction are comparing it to the libraries listed below
- The repo for "MMPareto: Boosting Multimodal Learning with Innocent Unimodal Assistance", ICML 2024☆42Updated 10 months ago
- The repo for "Enhancing Multi-modal Cooperation via Sample-level Modality Valuation", CVPR 2024☆51Updated 6 months ago
- Codebase for "Multimodal Distillation for Egocentric Action Recognition" (ICCV 2023)☆25Updated last year
- ☆79Updated 2 years ago
- Code for the paper Visual Explanations of Image–Text Representations via Multi-Modal Information Bottleneck Attribution☆49Updated last year
- Pytorch implementation of "Test-time Adaption against Multi-modal Reliability Bias".☆35Updated 4 months ago
- This is the official code for the paper "Reconstruct before Query: Continual Missing Modality Learning with Decomposed Prompt Collaborati…☆10Updated 8 months ago
- ☆61Updated last year
- ☆36Updated 2 years ago
- A python implement for Certifiable Robust Multi-modal Training☆18Updated 9 months ago
- PMR: Prototypical Modal Rebalance for Multimodal Learning☆38Updated 2 years ago
- offical implementation of "Calibrating Multimodal Learning" on ICML 2023☆21Updated last year
- Code for dmrnet☆22Updated 2 months ago
- [NeurIPS 2024 Spotlight] Code for the paper "Flex-MoE: Modeling Arbitrary Modality Combination via the Flexible Mixture-of-Experts"☆50Updated 6 months ago
- [ICLR 2023] Masked Frequency Modeling for Self-Supervised Visual Pre-Training☆75Updated 2 years ago
- Multimodal Variational Auto-encoder based Audio-Visual Segmentation [ICCV2023].☆19Updated 7 months ago
- [ICLR2023] PLOT: Prompt Learning with Optimal Transport for Vision-Language Models☆161Updated last year
- ☆26Updated last year
- Official Repository for CVPR 2024 Paper: "Large Language Models are Good Prompt Learners for Low-Shot Image Classification"☆35Updated 10 months ago
- [ECCV 2024] Official PyTorch implementation of LUT "Learning with Unmasked Tokens Drives Stronger Vision Learners"☆12Updated 5 months ago
- [ICLR 2024] Test-Time Adaptation with CLIP Reward for Zero-Shot Generalization in Vision-Language Models.☆76Updated 9 months ago
- The official implementation of paper "Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrieval" accepted by NeurIPS…☆24Updated 11 months ago
- [ICLR 23 oral] The Modality Focusing Hypothesis: Towards Understanding Crossmodal Knowledge Distillation☆44Updated last year
- Official Implementation of "Geometric Multimodal Contrastive Representation Learning" (https://arxiv.org/abs/2202.03390)☆28Updated 4 months ago
- code for "Semi-supervised Domain Adaptation via Prototype-based Multi-level Learning"☆15Updated last year
- Distribution-Aware Prompt Tuning for Vision-Language Models (ICCV 2023)☆38Updated last year
- Official Implementation of "Read-only Prompt Optimization for Vision-Language Few-shot Learning", ICCV 2023☆53Updated last year
- Official PyTorch Implementation for Active Prompt Learning in Vision Language Models☆33Updated 10 months ago
- Official code for "Understanding and Mitigating Overfitting in Prompt Tuning for Vision-Language Models" (TCSVT'2023)☆27Updated last year
- Learning Hierarchical Prompt with Structured Linguistic Knowledge for Vision-Language Models (AAAI 2024)☆71Updated 3 months ago