YingWANGG / M2IB
Code for the paper Visual Explanations of Image–Text Representations via Multi-Modal Information Bottleneck Attribution
☆31Updated 5 months ago
Related projects: ⓘ
- [ICLR2023] PLOT: Prompt Learning with Optimal Transport for Vision-Language Models☆136Updated 9 months ago
- [ICCV2023] The repo for "Boosting Multi-modal Model Performance with Adaptive Gradient Modulation".☆24Updated 7 months ago
- Official code repository for "Meta Learning to Bridge Vision and Language Models for Multimodal Few-Shot Learning" (published at ICLR 202…☆48Updated last year
- Task Residual for Tuning Vision-Language Models (CVPR 2023)☆65Updated last year
- Learning Hierarchical Prompt with Structured Linguistic Knowledge for Vision-Language Models (AAAI 2024)☆62Updated 7 months ago
- [NeurIPS 2023] Generalized Logit Adjustment☆33Updated 4 months ago
- CVPR 2023: Language in a Bottle: Language Model Guided Concept Bottlenecks for Interpretable Image Classification☆68Updated 3 months ago
- [ICLR 2024 Oral] Less is More: Fewer Interpretable Region via Submodular Subset Selection☆66Updated 3 weeks ago
- [NeurIPS 2023] Align Your Prompts: Test-Time Prompting with Distribution Alignment for Zero-Shot Generalization☆93Updated 7 months ago
- Official code for ICCV 2023 paper, "Improving Zero-Shot Generalization for CLIP with Synthesized Prompts"☆88Updated 6 months ago
- Code and Dataset for the paper "LAMM: Label Alignment for Multi-Modal Prompt Learning" AAAI 2024☆27Updated 8 months ago
- ☆81Updated 9 months ago
- Exploring prompt tuning with pseudolabels for multiple modalities, learning settings, and training strategies.☆41Updated last week
- Test-time Prompt Tuning (TPT) for zero-shot generalization in vision-language models (NeurIPS 2022))☆136Updated last year
- [ICLR 23 oral] The Modality Focusing Hypothesis: Towards Understanding Crossmodal Knowledge Distillation☆36Updated last year
- Preventing Zero-Shot Transfer Degradation in Continual Learning of Vision-Language Models☆75Updated 6 months ago
- ☆31Updated last year
- The official implementation of paper "Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrieval" accepted by NeurIPS…☆21Updated 4 months ago
- Code and results accompanying our paper titled CHiLS: Zero-Shot Image Classification with Hierarchical Label Sets☆53Updated last year
- Implementation of "VL-Mamba: Exploring State Space Models for Multimodal Learning"☆75Updated 5 months ago
- Official code for ICLR 2024 paper, "A Hard-to-Beat Baseline for Training-free CLIP-based Adaptation"☆61Updated 4 months ago
- [CVPR 2023] Diversity-Aware Meta Visual Prompting☆73Updated 9 months ago
- About Code Release for "CLIPood: Generalizing CLIP to Out-of-Distributions" (ICML 2023), https://arxiv.org/abs/2302.00864☆58Updated last year
- This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strat…☆66Updated 5 months ago
- [CVPR2024 Highlight] Official implementation for Transferable Visual Prompting. The paper "Exploring the Transferability of Visual Prompt…☆26Updated 2 months ago
- [CVPR 2024] FairCLIP: Harnessing Fairness in Vision-Language Learning☆46Updated last month
- Official Implementation of "Read-only Prompt Optimization for Vision-Language Few-shot Learning", ICCV 2023☆48Updated last year
- Code for Negative Yields Positive: Unified Dual-Path Adapter for Vision-Language Models☆21Updated 5 months ago
- source code for ICLR'23 paper "Non-parametric Outlier Synthesis"☆51Updated 11 months ago
- Distilling Large Vision-Language Model with Out-of-Distribution Generalizability (ICCV 2023)☆50Updated 5 months ago