YingWANGG / M2IB
Code for the paper Visual Explanations of Image–Text Representations via Multi-Modal Information Bottleneck Attribution
☆50Updated last year
Alternatives and similar repositories for M2IB
Users that are interested in M2IB are comparing it to the libraries listed below
Sorting:
- CVPR 2023: Language in a Bottle: Language Model Guided Concept Bottlenecks for Interpretable Image Classification☆91Updated 11 months ago
- ☆37Updated last month
- The repo for "MMPareto: Boosting Multimodal Learning with Innocent Unimodal Assistance", ICML 2024☆42Updated 10 months ago
- The official pytorch implemention of our CVPR-2024 paper "MMA: Multi-Modal Adapter for Vision-Language Models".☆67Updated 3 weeks ago
- [ICLR2023] PLOT: Prompt Learning with Optimal Transport for Vision-Language Models☆161Updated last year
- Learning Hierarchical Prompt with Structured Linguistic Knowledge for Vision-Language Models (AAAI 2024)☆71Updated 3 months ago
- The repo for "Enhancing Multi-modal Cooperation via Sample-level Modality Valuation", CVPR 2024☆52Updated 6 months ago
- PMR: Prototypical Modal Rebalance for Multimodal Learning☆38Updated 2 years ago
- Code for dmrnet☆23Updated 2 months ago
- [ICLR 23 oral] The Modality Focusing Hypothesis: Towards Understanding Crossmodal Knowledge Distillation☆44Updated last year
- [NeurIPS 2023] Align Your Prompts: Test-Time Prompting with Distribution Alignment for Zero-Shot Generalization☆105Updated last year
- [CVPR 2024] FairCLIP: Harnessing Fairness in Vision-Language Learning☆75Updated last month
- [ICLR 2024 Spotlight] "Negative Label Guided OOD Detection with Pretrained Vision-Language Models"☆21Updated 6 months ago
- AlignCLIP: Improving Cross-Modal Alignment in CLIP (ICLR 2025)☆39Updated 2 months ago
- The PyTorch implementation for "DEAL: Disentangle and Localize Concept-level Explanations for VLMs" (ECCV 2024 Strong Double Blind)☆19Updated 6 months ago
- [ICLR 2023] Official code repository for "Meta Learning to Bridge Vision and Language Models for Multimodal Few-Shot Learning"☆59Updated last year
- [ICLR 2024] Test-Time Adaptation with CLIP Reward for Zero-Shot Generalization in Vision-Language Models.☆78Updated 9 months ago
- About Code Release for "CLIPood: Generalizing CLIP to Out-of-Distributions" (ICML 2023), https://arxiv.org/abs/2302.00864☆65Updated last year
- Domain Generalization through Distilling CLIP with Language Guidance☆29Updated last year
- ☆36Updated 2 years ago
- [ECCV 2024] Mind the Interference: Retaining Pre-trained Knowledge in Parameter Efficient Continual Learning of Vision-Language Models☆47Updated 10 months ago
- Official Implementation of "Read-only Prompt Optimization for Vision-Language Few-shot Learning", ICCV 2023☆53Updated last year
- [CVPR 2024] Official Repository for "Efficient Test-Time Adaptation of Vision-Language Models"☆90Updated 10 months ago
- Implementation of "VL-Mamba: Exploring State Space Models for Multimodal Learning"☆81Updated last year
- ☆34Updated 6 months ago
- ☆95Updated last year
- FineCLIP: Self-distilled Region-based CLIP for Better Fine-grained Understanding☆19Updated 5 months ago
- Exploring prompt tuning with pseudolabels for multiple modalities, learning settings, and training strategies.☆50Updated 6 months ago
- This is the official code for NeurIPS 2023 paper "Learning Unseen Modality Interaction"☆17Updated last year
- Instruction Tuning in Continual Learning paradigm☆47Updated 3 months ago