William-wAng618 / M2PT
Official repo of M$^2$PT: Multimodal Prompt Tuning for Zero-shot Instruction Learning
☆18Updated 2 months ago
Alternatives and similar repositories for M2PT:
Users that are interested in M2PT are comparing it to the libraries listed below
- Instruction Tuning in Continual Learning paradigm☆38Updated last month
- Official implementation of NeurIPS 2024 "Visual Fourier Prompt Tuning"☆26Updated 2 weeks ago
- The official implementation of the CVPR'2024 work Interference-Free Low-Rank Adaptation for Continual Learning☆58Updated 4 months ago
- [NeurIPS 2023] Generalized Logit Adjustment☆34Updated 9 months ago
- [ECCV 2024] Mind the Interference: Retaining Pre-trained Knowledge in Parameter Efficient Continual Learning of Vision-Language Models☆39Updated 6 months ago
- Exploring prompt tuning with pseudolabels for multiple modalities, learning settings, and training strategies.☆47Updated 2 months ago
- [CVPR23] "Understanding and Improving Visual Prompting: A Label-Mapping Perspective" by Aochuan Chen, Yuguang Yao, Pin-Yu Chen, Yihua Zha…☆52Updated last year
- Multimodal Instruction Tuning with Conditional Mixture of LoRA (ACL 2024)☆12Updated 5 months ago
- ☆26Updated 4 months ago
- Code for the paper Visual Explanations of Image–Text Representations via Multi-Modal Information Bottleneck Attribution☆41Updated 10 months ago
- Official pytorch implementation of "RITUAL: Random Image Transformations as a Universal Anti-hallucination Lever in Large Vision Language…☆11Updated last month
- Consistent Prompting for Rehearsal-Free Continual Learning [CVPR2024]☆31Updated 7 months ago
- [ICCV 2023 oral] This is the official repository for our paper: ''Sensitivity-Aware Visual Parameter-Efficient Fine-Tuning''.☆65Updated last year
- ☆14Updated 2 months ago
- [ICCV 2023] A Unified Continual Learning Framework with General Parameter-Efficient Tuning☆75Updated 3 months ago
- About Code Release for "CLIPood: Generalizing CLIP to Out-of-Distributions" (ICML 2023), https://arxiv.org/abs/2302.00864☆63Updated last year
- The official implementation of "2024NeurIPS Dynamic Tuning Towards Parameter and Inference Efficiency for ViT Adaptation"☆40Updated last month
- CVPR 2023: Language in a Bottle: Language Model Guided Concept Bottlenecks for Interpretable Image Classification☆86Updated 8 months ago
- The First to Know: How Token Distributions Reveal Hidden Knowledge in Large Vision-Language Models?☆23Updated 2 months ago
- Official code for ICLR 2024 paper, "A Hard-to-Beat Baseline for Training-free CLIP-based Adaptation"☆73Updated 9 months ago
- Code for ICML 2024 paper (Oral) — Test-Time Model Adaptation with Only Forward Passes☆61Updated 5 months ago
- [ICLR 2024] ViDA: Homeostatic Visual Domain Adapter for Continual Test Time Adaptation☆59Updated 9 months ago
- Official Pytorch implementation of "E2VPT: An Effective and Efficient Approach for Visual Prompt Tuning". (ICCV2023)☆70Updated last year
- Self-training LLaVA for medical☆14Updated 2 months ago
- ☆16Updated 3 months ago
- ☆52Updated 9 months ago
- [NeurIPS 2024] Code for Dual Prototype Evolving for Test-Time Generalization of Vision-Language Models☆30Updated last month
- Preventing Zero-Shot Transfer Degradation in Continual Learning of Vision-Language Models☆86Updated 10 months ago
- PyTorch implementation of our CVPR 2024 paper "Unified Entropy Optimization for Open-Set Test-Time Adaptation"☆19Updated 5 months ago
- Official code for ICCV 2023 paper, "Improving Zero-Shot Generalization for CLIP with Synthesized Prompts"☆96Updated 10 months ago