lihongcs / AGMLinks
[ICCV2023] The repo for "Boosting Multi-modal Model Performance with Adaptive Gradient Modulation".
☆25Updated last year
Alternatives and similar repositories for AGM
Users that are interested in AGM are comparing it to the libraries listed below
Sorting:
- [ICLR 23 oral] The Modality Focusing Hypothesis: Towards Understanding Crossmodal Knowledge Distillation☆45Updated 2 years ago
- The repo for "MMPareto: Boosting Multimodal Learning with Innocent Unimodal Assistance", ICML 2024☆43Updated last year
- ☆27Updated 2 years ago
- PMR: Prototypical Modal Rebalance for Multimodal Learning☆39Updated 2 years ago
- Learning Hierarchical Prompt with Structured Linguistic Knowledge for Vision-Language Models (AAAI 2024)☆73Updated 5 months ago
- The official implementation of paper "Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrieval" accepted by NeurIPS…☆26Updated last year
- ☆61Updated 2 years ago
- [ICLR2023] PLOT: Prompt Learning with Optimal Transport for Vision-Language Models☆167Updated last year
- ☆37Updated 2 years ago
- [ICCV 2023] Prompt-aligned Gradient for Prompt Tuning☆165Updated 2 years ago
- Official Implementation of "Read-only Prompt Optimization for Vision-Language Few-shot Learning", ICCV 2023☆53Updated last year
- [ICLR 2024] Test-Time Adaptation with CLIP Reward for Zero-Shot Generalization in Vision-Language Models.☆82Updated 11 months ago
- [NeurIPS 2023] Generalized Logit Adjustment☆38Updated last year
- Multimodal Prompting with Missing Modalities for Visual Recognition, CVPR'23☆209Updated last year
- Implementation of "VL-Mamba: Exploring State Space Models for Multimodal Learning"☆80Updated last year
- Code for the paper Visual Explanations of Image–Text Representations via Multi-Modal Information Bottleneck Attribution☆53Updated last year
- Code for DeCo: Decoupling token compression from semanchc abstraction in multimodal large language models☆40Updated this week
- [AAAI 2024] DGL: Dynamic Global-Local Prompt Tuning for Text-Video Retrieval.☆41Updated 9 months ago
- [TPAMI 2024] Probabilistic Contrastive Learning for Long-Tailed Visual Recognition☆82Updated 9 months ago
- PyTorch code for "Contrastive Region Guidance: Improving Grounding in Vision-Language Models without Training"☆35Updated last year
- ☆96Updated last year
- The repo for "Enhancing Multi-modal Cooperation via Sample-level Modality Valuation", CVPR 2024☆53Updated 8 months ago
- [ICML 2024] "Visual-Text Cross Alignment: Refining the Similarity Score in Vision-Language Models"☆51Updated 10 months ago
- [NeurIPS 2023] Align Your Prompts: Test-Time Prompting with Distribution Alignment for Zero-Shot Generalization☆106Updated last year
- A python implement for Certifiable Robust Multi-modal Training☆19Updated 3 weeks ago
- ☆23Updated 2 years ago
- ☆40Updated last month
- [CVPR 2024] Do you remember? Dense Video Captioning with Cross-Modal Memory Retrieval☆59Updated last year
- [CVPR 2024] Improving language-visual pretraining efficiency by perform cluster-based masking on images.☆28Updated last year
- ✨A curated list of papers on the uncertainty in multi-modal large language model (MLLM).☆49Updated 3 months ago