William-wAng618 / M2PTLinks
Official repo of M$^2$PT: Multimodal Prompt Tuning for Zero-shot Instruction Learning
☆24Updated 4 months ago
Alternatives and similar repositories for M2PT
Users that are interested in M2PT are comparing it to the libraries listed below
Sorting:
- Diffusion-TTA improves pre-trained discriminative models such as image classifiers or segmentors using pre-trained generative models.☆74Updated last year
- [ECCV 2024] API: Attention Prompting on Image for Large Vision-Language Models☆98Updated 10 months ago
- [CVPR2024 Highlight] Official implementation for Transferable Visual Prompting. The paper "Exploring the Transferability of Visual Prompt…☆44Updated 7 months ago
- [ICLR 2025] See What You Are Told: Visual Attention Sink in Large Multimodal Models☆37Updated 5 months ago
- Instruction Tuning in Continual Learning paradigm☆54Updated 6 months ago
- [NeurIPS 2024] MoME: Mixture of Multimodal Experts for Generalist Multimodal Large Language Models☆69Updated 3 months ago
- cliptrase☆41Updated 11 months ago
- [ECCV 2024] Mind the Interference: Retaining Pre-trained Knowledge in Parameter Efficient Continual Learning of Vision-Language Models☆51Updated last year
- Everything to the Synthetic: Diffusion-driven Test-time Adaptation via Synthetic-Domain Alignment, arXiv 2024 / CVPR 2025☆30Updated 5 months ago
- [ICLR 2024] Test-Time Adaptation with CLIP Reward for Zero-Shot Generalization in Vision-Language Models.☆85Updated last year
- [CVPR 2025] Mitigating Object Hallucinations in Large Vision-Language Models with Assembly of Global and Local Attention☆41Updated last year
- 🔎Official code for our paper: "VL-Uncertainty: Detecting Hallucination in Large Vision-Language Model via Uncertainty Estimation".☆39Updated 4 months ago
- Code for our ICML'24 on multimodal dataset distillation☆38Updated 9 months ago
- MADTP: Multimodal Alignment-Guided Dynamic Token Pruning for Accelerating Vision-Language Transformer☆45Updated 11 months ago
- Exploring prompt tuning with pseudolabels for multiple modalities, learning settings, and training strategies.☆50Updated 9 months ago
- [NeurIPS 2023] Generalized Logit Adjustment☆38Updated last year
- ☆16Updated 8 months ago
- [CVPR 2025 (Oral)] Mitigating Hallucinations in Large Vision-Language Models via DPO: On-Policy Data Hold the Key☆67Updated 2 months ago
- Official implementation of NeurIPS 2024 "Visual Fourier Prompt Tuning"☆32Updated 6 months ago
- [ICLR 2025] Official Implementation of Local-Prompt: Extensible Local Prompts for Few-Shot Out-of-Distribution Detection☆42Updated last week
- The official implementation of "2024NeurIPS Dynamic Tuning Towards Parameter and Inference Efficiency for ViT Adaptation"☆46Updated 7 months ago
- [NeurIPS 2024] Mitigating Object Hallucination via Concentric Causal Attention☆58Updated 7 months ago
- Official implementation for CVPR'23 paper "BlackVIP: Black-Box Visual Prompting for Robust Transfer Learning"☆111Updated last year
- [CVPR 2025] Devils in Middle Layers of Large Vision-Language Models: Interpreting, Detecting and Mitigating Object Hallucinations via Att…☆26Updated 5 months ago
- [ICCV 2025] ONLY: One-Layer Intervention Sufficiently Mitigates Hallucinations in Large Vision-Language Models☆26Updated last month
- Uni-OVSeg is a weakly supervised open-vocabulary segmentation framework that leverages unpaired mask-text pairs.☆52Updated last year
- Hyperbolic Safety-Aware Vision-Language Models. CVPR 2025☆22Updated 4 months ago
- CLIP-MoE: Mixture of Experts for CLIP☆42Updated 10 months ago
- [ICLR 2024] ViDA: Homeostatic Visual Domain Adapter for Continual Test Time Adaptation☆68Updated last year
- PyTorch code for "Contrastive Region Guidance: Improving Grounding in Vision-Language Models without Training"☆35Updated last year