lihong2303 / AGM
[ICCV2023] The repo for "Boosting Multi-modal Model Performance with Adaptive Gradient Modulation".
☆24Updated last year
Alternatives and similar repositories for AGM:
Users that are interested in AGM are comparing it to the libraries listed below
- The repo for "MMPareto: Boosting Multimodal Learning with Innocent Unimodal Assistance", ICML 2024☆38Updated 7 months ago
- PMR: Prototypical Modal Rebalance for Multimodal Learning☆36Updated last year
- The repo for "Enhancing Multi-modal Cooperation via Sample-level Modality Valuation", CVPR 2024☆47Updated 3 months ago
- [ICLR 23 oral] The Modality Focusing Hypothesis: Towards Understanding Crossmodal Knowledge Distillation☆42Updated last year
- A python implement for Certifiable Robust Multi-modal Training☆17Updated 6 months ago
- Code for dmrnet☆21Updated 6 months ago
- [CVPR2024 Highlight] Official implementation for Transferable Visual Prompting. The paper "Exploring the Transferability of Visual Prompt…☆36Updated 2 months ago
- TupleInfoNCE ICCV21☆16Updated 2 years ago
- The repo for "Diagnosing and Re-learning for Balanced Multi-modal Learning", ECCV 2024☆23Updated 6 months ago
- The official implementation of ECCV2024 paper "Facial Affective Behavior Analysis with Instruction Tuning"☆23Updated last month
- ☆35Updated 2 years ago
- Multimodal Learning Method MLA for CVPR 2024☆75Updated 8 months ago
- Implementation of "VL-Mamba: Exploring State Space Models for Multimodal Learning"☆80Updated 11 months ago
- [NeurIPS 2023] Generalized Logit Adjustment☆34Updated 10 months ago
- [AAAI 2024] DGL: Dynamic Global-Local Prompt Tuning for Text-Video Retrieval.☆36Updated 4 months ago
- [CVPR 2023] Diversity-Aware Meta Visual Prompting☆81Updated last year
- Multimodal Prompting with Missing Modalities for Visual Recognition, CVPR'23☆191Updated last year
- ☆62Updated last year
- Code for the paper Visual Explanations of Image–Text Representations via Multi-Modal Information Bottleneck Attribution☆45Updated 10 months ago
- [ICLR2023] PLOT: Prompt Learning with Optimal Transport for Vision-Language Models☆154Updated last year
- [CVPR 2024] Improving language-visual pretraining efficiency by perform cluster-based masking on images.☆26Updated 9 months ago
- Official code for CVPR 2024 paper, "Audio-Visual Segmentation via Unlabeled Frame Exploitation""☆11Updated 7 months ago
- [NeurIPS'23] DropPos: Pre-Training Vision Transformers by Reconstructing Dropped Positions☆61Updated 9 months ago
- [ECCV 2024] Mind the Interference: Retaining Pre-trained Knowledge in Parameter Efficient Continual Learning of Vision-Language Models☆40Updated 7 months ago
- PyTorch code for "Contrastive Region Guidance: Improving Grounding in Vision-Language Models without Training"☆32Updated 11 months ago
- This is the official code for NeurIPS 2023 paper "Learning Unseen Modality Interaction"☆15Updated last year
- ICML2024-ReconBoost: Boosting Can Achieve Modality Reconcilement☆21Updated 9 months ago
- ☆24Updated last year
- Diffusion-TTA improves pre-trained discriminative models such as image classifiers or segmentors using pre-trained generative models.☆65Updated 10 months ago
- [CVPR2023] Context De-confounded Emotion Recognition☆18Updated last year