William-wAng618 / M2PT
Official repo of M$^2$PT: Multimodal Prompt Tuning for Zero-shot Instruction Learning
☆21Updated 3 weeks ago
Alternatives and similar repositories for M2PT:
Users that are interested in M2PT are comparing it to the libraries listed below
- The First to Know: How Token Distributions Reveal Hidden Knowledge in Large Vision-Language Models?☆28Updated 5 months ago
- ☆48Updated 4 months ago
- [CVPR 2025 (Oral)] Mitigating Hallucinations in Large Vision-Language Models via DPO: On-Policy Data Hold the Key☆48Updated 2 weeks ago
- [ECCV 2024] API: Attention Prompting on Image for Large Vision-Language Models☆84Updated 6 months ago
- [CVPR2024 Highlight] Official implementation for Transferable Visual Prompting. The paper "Exploring the Transferability of Visual Prompt…☆39Updated 4 months ago
- This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strat…☆78Updated 2 months ago
- PyTorch code for "Contrastive Region Guidance: Improving Grounding in Vision-Language Models without Training"☆34Updated last year
- 🔎Official code for our paper: "VL-Uncertainty: Detecting Hallucination in Large Vision-Language Model via Uncertainty Estimation".☆32Updated last month
- ☆16Updated 5 months ago
- Instruction Tuning in Continual Learning paradigm☆47Updated 2 months ago
- ☆36Updated 2 months ago
- Official pytorch implementation of "RITUAL: Random Image Transformations as a Universal Anti-hallucination Lever in Large Vision Language…☆10Updated 4 months ago
- MADTP: Multimodal Alignment-Guided Dynamic Token Pruning for Accelerating Vision-Language Transformer☆41Updated 7 months ago
- Code for our ICML'24 on multimodal dataset distillation☆37Updated 6 months ago
- Data distillation benchmark☆58Updated last week
- [ICCV 2023 oral] This is the official repository for our paper: ''Sensitivity-Aware Visual Parameter-Efficient Fine-Tuning''.☆68Updated last year
- Less is More: High-value Data Selection for Visual Instruction Tuning☆12Updated 3 months ago
- ☆11Updated 5 months ago
- Everything to the Synthetic: Diffusion-driven Test-time Adaptation via Synthetic-Domain Alignment, arXiv 2024 / CVPR 2025☆26Updated last month
- Official implementation of NeurIPS 2024 "Visual Fourier Prompt Tuning"☆26Updated 3 months ago
- ☆53Updated 5 months ago
- [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models☆71Updated 10 months ago
- Look, Compare, Decide: Alleviating Hallucination in Large Vision-Language Models via Multi-View Multi-Path Reasoning☆20Updated 7 months ago
- ☆72Updated last month
- [ICLR 2025] MLLM can see? Dynamic Correction Decoding for Hallucination Mitigation☆58Updated 4 months ago
- [ECCV 2024] Mind the Interference: Retaining Pre-trained Knowledge in Parameter Efficient Continual Learning of Vision-Language Models☆46Updated 9 months ago
- CLIP-MoE: Mixture of Experts for CLIP☆31Updated 6 months ago
- ☆73Updated 3 weeks ago
- PyTorch Implementation of "Divide, Conquer and Combine: A Training-Free Framework for High-Resolution Image Perception in Multimodal Larg…☆21Updated 2 months ago
- Benchmarking Generalized Out-of-Distribution Detection with Vision-Language Models☆22Updated 4 months ago