zycheiheihei / Transferable-Visual-Prompting
[CVPR2024 Highlight] Official implementation for Transferable Visual Prompting. The paper "Exploring the Transferability of Visual Prompting for Multimodal Large Language Models" has been accepted in CVPR2024.
☆32Updated 4 months ago
Related projects ⓘ
Alternatives and complementary repositories for Transferable-Visual-Prompting
- Task Residual for Tuning Vision-Language Models (CVPR 2023)☆66Updated last year
- Distribution-Aware Prompt Tuning for Vision-Language Models (ICCV 2023)☆37Updated 11 months ago
- PyTorch code for "Contrastive Region Guidance: Improving Grounding in Vision-Language Models without Training"☆28Updated 8 months ago
- [NeurIPS 2023] Align Your Prompts: Test-Time Prompting with Distribution Alignment for Zero-Shot Generalization☆97Updated 9 months ago
- Code Release of F-LMM: Grounding Frozen Large Multimodal Models☆47Updated 3 months ago
- [ICLR 2024] Test-Time Adaptation with CLIP Reward for Zero-Shot Generalization in Vision-Language Models.☆56Updated 3 months ago
- [CVPR 2024] Improving language-visual pretraining efficiency by perform cluster-based masking on images.☆22Updated 6 months ago
- [ECCV 2024] API: Attention Prompting on Image for Large Vision-Language Models☆47Updated last month
- HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)☆41Updated 4 months ago
- [NeurIPS 2024] Official PyTorch implementation of LoTLIP: Improving Language-Image Pre-training for Long Text Understanding☆30Updated this week
- FreeVA: Offline MLLM as Training-Free Video Assistant☆48Updated 5 months ago
- Instruction Tuning in Continual Learning paradigm☆26Updated 4 months ago
- [CVPR' 2024] Contrasting Intra-Modal and Ranking Cross-Modal Hard Negatives to Enhance Visio-Linguistic Fine-grained Understanding☆41Updated 3 months ago
- This repository houses the code for the paper - "The Neglected of VLMs"☆23Updated 3 months ago
- VisualGPTScore for visio-linguistic reasoning☆26Updated last year
- Exploring prompt tuning with pseudolabels for multiple modalities, learning settings, and training strategies.☆44Updated last week
- Official implementation of "Why are Visually-Grounded Language Models Bad at Image Classification?" (NeurIPS 2024)☆51Updated last month
- The First to Know: How Token Distributions Reveal Hidden Knowledge in Large Vision-Language Models?☆19Updated 2 weeks ago
- Code for Label Propagation for Zero-shot Classification with Vision-Language Models (CVPR2024)☆33Updated 3 months ago
- ☆26Updated 9 months ago
- Compress conventional Vision-Language Pre-training data☆49Updated last year
- Official code for "Understanding and Mitigating Overfitting in Prompt Tuning for Vision-Language Models" (TCSVT'2023)☆27Updated 10 months ago
- [ECCV2024] Learning Video Context as Interleaved Multimodal Sequences☆29Updated last month
- Official implementation of "Towards Distribution-Agnostic Generalized Category Discovery" (NIPS 2023)☆24Updated last year
- This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strat…☆72Updated 7 months ago
- ☆21Updated 5 months ago
- Towards a Unified View on Visual Parameter-Efficient Transfer Learning☆27Updated 2 years ago
- [CVPR2024] The code of "UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory"☆64Updated last month
- Accelerating Vision-Language Pretraining with Free Language Modeling (CVPR 2023)☆31Updated last year
- [ECCV 2024] Mind the Interference: Retaining Pre-trained Knowledge in Parameter Efficient Continual Learning of Vision-Language Models☆32Updated 4 months ago