nyukat / greedy_multimodal_learning
Characterizing and overcoming the greedy nature of learning in multi-modal deep neural networks
☆27Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for greedy_multimodal_learning
- Official Implementation of "Geometric Multimodal Contrastive Representation Learning" (https://arxiv.org/abs/2202.03390)☆26Updated 2 years ago
- [NeurIPS 2023, ICMI 2023] Quantifying & Modeling Multimodal Interactions☆60Updated last week
- [NeurIPS 2023] Factorized Contrastive Learning: Going Beyond Multi-view Redundancy☆60Updated 11 months ago
- ☆63Updated 2 years ago
- [ICLR 2023] MultiViz: Towards Visualizing and Understanding Multimodal Models☆90Updated 2 months ago
- Pytorch implementation of SMIL: Multimodal Learning with Severely Missing Modality (AAAI 2021)☆91Updated 2 years ago
- ☆25Updated 3 years ago
- Temperature Schedules for self-supervised contrastive methods on long-tail data (ICLR'23)☆18Updated last year
- ☆10Updated 10 months ago
- The repo for "MMPareto: Boosting Multimodal Learning with Innocent Unimodal Assistance", ICML 2024☆34Updated 4 months ago
- Multimodal Masked Autoencoders (M3AE): A JAX/Flax Implementation☆100Updated 7 months ago
- ProbVLM: Probabilistic Adapter for Frozen Vision-Language Models☆31Updated 10 months ago
- offical implementation of "Calibrating Multimodal Learning" on ICML 2023☆19Updated last year
- Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning☆123Updated 2 years ago
- SSR: An Efficient and Robust Framework for Learning with Unknown Label Noise (BMVC2022)☆29Updated last month
- LISA for ICML 2022☆47Updated last year
- Self-Supervised Learning with Data Augmentations Provably Isolates Content from Style☆48Updated 2 years ago
- Official Code for ICML 2023 Paper: On the Generalization of Multi-modal Contrastive Learning☆25Updated 11 months ago
- Codebase for "Multimodal Distillation for Egocentric Action Recognition" (ICCV 2023)☆23Updated 9 months ago
- [TMLR 2022] High-Modality Multimodal Transformer☆107Updated last week
- [NeurIPS21] TTT++: When Does Self-supervised Test-time Training Fail or Thrive?☆58Updated 2 years ago
- Code for "Surgical Fine-Tuning Improves Adaptation to Distribution Shifts" published at ICLR 2023☆28Updated last year
- CVPR 2022, Robust Contrastive Learning against Noisy Views☆83Updated 2 years ago
- [CVPR 2022 Oral] Rethinking Minimal Sufficient Representation in Contrastive Learning☆66Updated last year
- Code for the ICCV 2023 paper "Benchmarking Low-Shot Robustness to Natural Distribution Shifts"☆11Updated 9 months ago
- Hyperbolic Busemann Learning with Ideal Prototypes, NeurIPS2021☆24Updated 2 years ago
- Official Pytorch implementation of "Improved Probabilistic Image-Text Representations" (ICLR 2024)☆51Updated 5 months ago
- This is the official repo for our CVPR22 paper: Scalable Penalized Regression for Noise Detection in Learning With Noisy Labels.☆17Updated 7 months ago
- Medical multi-modal learning with missing modality data (MLHC 2023)☆12Updated last year
- PyTorch Implementation - Mine Your Own vieW: Self-Supervised Learning Through Across-Sample Prediction☆32Updated 2 years ago