XIAO4579 / Vlm-interpretability
Official implementation for the paper"Towards Understanding How Knowledge Evolves in Large Vision-Language Models"
☆11Updated 2 weeks ago
Alternatives and similar repositories for Vlm-interpretability:
Users that are interested in Vlm-interpretability are comparing it to the libraries listed below
- [CVPR 2025] Few-shot Recognition via Stage-Wise Retrieval-Augmented Finetuning☆15Updated 3 weeks ago
- cliptrase☆35Updated 7 months ago
- Emerging Pixel Grounding in Large Multimodal Models Without Grounding Supervision☆40Updated last month
- [CVPR 2025] Mitigating Object Hallucinations in Large Vision-Language Models with Assembly of Global and Local Attention☆29Updated 9 months ago
- Pytorch Implementation for CVPR 2024 paper: Learn to Rectify the Bias of CLIP for Unsupervised Semantic Segmentation☆41Updated this week
- [ECCV 2024] Mind the Interference: Retaining Pre-trained Knowledge in Parameter Efficient Continual Learning of Vision-Language Models☆46Updated 9 months ago
- [NeurIPS 2024] Official PyTorch implementation of LoTLIP: Improving Language-Image Pre-training for Long Text Understanding☆43Updated 3 months ago
- [ECCV 2024] ControlCap: Controllable Region-level Captioning☆74Updated 6 months ago
- [NeurIPS2024] Repo for the paper `ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models'☆162Updated 3 months ago
- PyTorch code for "Contrastive Region Guidance: Improving Grounding in Vision-Language Models without Training"☆34Updated last year
- FreeDA: Training-Free Open-Vocabulary Segmentation with Offline Diffusion-Augmented Prototype Generation (CVPR 2024)☆41Updated 7 months ago
- [CVPR2025] Code Release of F-LMM: Grounding Frozen Large Multimodal Models☆84Updated 8 months ago
- [NeurIPS 2024] TransAgent: Transfer Vision-Language Foundation Models with Heterogeneous Agent Collaboration☆23Updated 6 months ago
- [ECCV 2024] API: Attention Prompting on Image for Large Vision-Language Models☆84Updated 6 months ago
- [NeurIPS 2024] Code for Dual Prototype Evolving for Test-Time Generalization of Vision-Language Models☆38Updated last month
- Official Implementation of "Read-only Prompt Optimization for Vision-Language Few-shot Learning", ICCV 2023☆53Updated last year
- [CVPR 2025] FLAIR: VLM with Fine-grained Language-informed Image Representations☆63Updated 3 weeks ago
- DeepPerception: Advancing R1-like Cognitive Visual Perception in MLLMs for Knowledge-Intensive Visual Grounding☆49Updated last month
- [EMNLP 2024] Preserving Multi-Modal Capabilities of Pre-trained VLMs for Improving Vision-Linguistic Compositionality☆16Updated 6 months ago
- PyTorch Implementation of NACLIP in "Pay Attention to Your Neighbours: Training-Free Open-Vocabulary Semantic Segmentation"☆53Updated 7 months ago
- OVMR: Open-Vocabulary Recognition with Multi-Modal References (CVPR24)☆27Updated last week
- ☆11Updated 9 months ago
- [ICLR 2024] Test-Time Adaptation with CLIP Reward for Zero-Shot Generalization in Vision-Language Models.☆76Updated 9 months ago
- [CVPR 2024] The repository contains the official implementation of "Open-Vocabulary Segmentation with Semantic-Assisted Calibration"☆70Updated 7 months ago
- TinyLLaVA-Video-R1: Towards Smaller LMMs for Video Reasoning☆40Updated this week
- ☆20Updated last year
- Repository for the paper: Teaching VLMs to Localize Specific Objects from In-context Examples☆23Updated 5 months ago
- CVPR2024: Dual Memory Networks: A Versatile Adaptation Approach for Vision-Language Models☆72Updated 9 months ago
- [CVPR 2024] Contrasting Intra-Modal and Ranking Cross-Modal Hard Negatives to Enhance Visio-Linguistic Fine-grained Understanding☆48Updated 2 weeks ago
- Official implementation of "Why are Visually-Grounded Language Models Bad at Image Classification?" (NeurIPS 2024)☆79Updated 6 months ago