zihuixue / MFH
[ICLR 23 oral] The Modality Focusing Hypothesis: Towards Understanding Crossmodal Knowledge Distillation
☆39Updated last year
Related projects ⓘ
Alternatives and complementary repositories for MFH
- [CVPR 2023] Diversity-Aware Meta Visual Prompting☆78Updated 11 months ago
- The repo for "MMPareto: Boosting Multimodal Learning with Innocent Unimodal Assistance", ICML 2024☆35Updated 4 months ago
- ☆25Updated last year
- A python implement for Certifiable Robust Multi-modal Training☆15Updated 3 months ago
- ☆38Updated last year
- The repo for "Enhancing Multi-modal Cooperation via Sample-level Modality Valuation", CVPR 2024☆39Updated 2 weeks ago
- [ICLR2023] PLOT: Prompt Learning with Optimal Transport for Vision-Language Models☆146Updated 11 months ago
- ☆83Updated 11 months ago
- [TPAMI 2024] Probabilistic Contrastive Learning for Long-Tailed Visual Recognition☆64Updated last month
- Learning Hierarchical Prompt with Structured Linguistic Knowledge for Vision-Language Models (AAAI 2024)☆67Updated 9 months ago
- PMR: Prototypical Modal Rebalance for Multimodal Learning☆30Updated last year
- [ICLR2024] The official implementation of paper "UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling", by …☆69Updated 9 months ago
- Implementation of "VL-Mamba: Exploring State Space Models for Multimodal Learning"☆78Updated 8 months ago
- ☆22Updated last year
- [ICCV2023] The repo for "Boosting Multi-modal Model Performance with Adaptive Gradient Modulation".☆24Updated 9 months ago
- This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strat…☆72Updated 7 months ago
- Task Residual for Tuning Vision-Language Models (CVPR 2023)☆66Updated last year
- Code for dmrnet☆16Updated 3 months ago
- Compress conventional Vision-Language Pre-training data☆49Updated last year
- Distilling Large Vision-Language Model with Out-of-Distribution Generalizability (ICCV 2023)☆53Updated 7 months ago
- [ICCV 2023 oral] This is the official repository for our paper: ''Sensitivity-Aware Visual Parameter-Efficient Fine-Tuning''.☆64Updated last year
- ☆61Updated last year
- The official implementation of paper "Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrieval" accepted by NeurIPS …☆21Updated 6 months ago
- Instruction Tuning in Continual Learning paradigm☆26Updated 4 months ago
- ☆33Updated 2 years ago
- [CVPR' 2024] Contrasting Intra-Modal and Ranking Cross-Modal Hard Negatives to Enhance Visio-Linguistic Fine-grained Understanding☆41Updated 3 months ago
- [ICLR 2023] Masked Frequency Modeling for Self-Supervised Visual Pre-Training☆68Updated last year
- Official implementation for CIGN☆14Updated last year
- Codes for ICML 2024 paper: "Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognition"☆40Updated 4 months ago
- [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"☆53Updated last year