jeongukjae / CLIP-self-attention-visualization
Plotting heatmaps with the self-attention of the [CLS] tokens in the last layer.
☆38Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for CLIP-self-attention-visualization
- Task Residual for Tuning Vision-Language Models (CVPR 2023)☆65Updated last year
- [NeurIPS2023] Official implementation and model release of the paper "What Makes Good Examples for Visual In-Context Learning?"☆167Updated 8 months ago
- [ECCV 2024] ControlCap: Controllable Region-level Captioning☆55Updated 2 weeks ago
- [CVPR2024 Highlight] Official implementation for Transferable Visual Prompting. The paper "Exploring the Transferability of Visual Prompt…☆32Updated 4 months ago
- ☆56Updated 2 years ago
- ☆58Updated 2 years ago
- Compress conventional Vision-Language Pre-training data☆49Updated last year
- Code and Models for "GeneCIS A Benchmark for General Conditional Image Similarity"☆54Updated last year
- Distribution-Aware Prompt Tuning for Vision-Language Models (ICCV 2023)☆37Updated 11 months ago
- Code for the paper: "SuS-X: Training-Free Name-Only Transfer of Vision-Language Models" [ICCV'23]☆94Updated last year
- This repo is the official implementation of UPL (Unsupervised Prompt Learning for Vision-Language Models).☆106Updated 2 years ago
- 📍 Official pytorch implementation of paper "ProtoCLIP: Prototypical Contrastive Language Image Pretraining" (IEEE TNNLS)☆48Updated last year
- [CVPR-2023] The official dataset of Advancing Visual Grounding with Scene Knowledge: Benchmark and Method.☆29Updated last year
- [ICLR 2024] Test-Time Adaptation with CLIP Reward for Zero-Shot Generalization in Vision-Language Models.☆55Updated 3 months ago
- ☆170Updated last year
- Repository for the paper: Teaching Structured Vision & Language Concepts to Vision & Language Models☆45Updated last year
- Code Release of F-LMM: Grounding Frozen Large Multimodal Models☆41Updated 3 months ago
- [CVPR2023] The code for 《Position-guided Text Prompt for Vision-Language Pre-training》☆149Updated last year
- Official code for "Understanding and Mitigating Overfitting in Prompt Tuning for Vision-Language Models" (TCSVT'2023)☆27Updated 10 months ago
- ☆60Updated last year
- FreeVA: Offline MLLM as Training-Free Video Assistant☆48Updated 5 months ago
- ☆55Updated last year
- LLaVA-NeXT-Image-Llama3-Lora, Modified from https://github.com/arielnlee/LLaVA-1.6-ft☆39Updated 3 months ago
- [ECCV 2024] Official PyTorch implementation of DreamLIP: Language-Image Pre-training with Long Captions☆106Updated last week
- Official repository for the ICCV 2023 paper: "Waffling around for Performance: Visual Classification with Random Words and Broad Concepts…☆52Updated last year
- Code implementation of our NeurIPS 2023 paper: Vocabulary-free Image Classification☆102Updated 9 months ago
- Distilling Large Vision-Language Model with Out-of-Distribution Generalizability (ICCV 2023)☆53Updated 7 months ago
- [CVPR2024] The code of "UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory"☆64Updated 3 weeks ago
- [ECCV2024] Learning Video Context as Interleaved Multimodal Sequences☆29Updated last month
- Augmenting with Language-guided Image Augmentation (ALIA)☆63Updated last year