pliang279 / FactorCLLinks
[NeurIPS 2023] Factorized Contrastive Learning: Going Beyond Multi-view Redundancy
☆69Updated last year
Alternatives and similar repositories for FactorCL
Users that are interested in FactorCL are comparing it to the libraries listed below
Sorting:
- [NeurIPS 2023, ICMI 2023] Quantifying & Modeling Multimodal Interactions☆77Updated 8 months ago
- [TMLR 2022] High-Modality Multimodal Transformer☆116Updated 8 months ago
- Official Implementation of "Geometric Multimodal Contrastive Representation Learning" (https://arxiv.org/abs/2202.03390)☆28Updated 6 months ago
- [ICLR 2023] MultiViz: Towards Visualizing and Understanding Multimodal Models☆96Updated 10 months ago
- Characterizing and overcoming the greedy nature of learning in multi-modal deep neural networks☆28Updated 3 years ago
- Official implementation for NeurIPS'23 paper "Geodesic Multi-Modal Mixup for Robust Fine-Tuning"☆34Updated 9 months ago
- Official Code for ICLR 2024 Paper: Non-negative Contrastive Learning☆45Updated last year
- Multimodal Masked Autoencoders (M3AE): A JAX/Flax Implementation☆103Updated 4 months ago
- [T-PAMI] A curated list of self-supervised multimodal learning resources.☆261Updated 11 months ago
- Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning☆157Updated 2 years ago
- PyTorch implementation of LIMoE☆53Updated last year
- ☆120Updated 2 years ago
- I2M2: Jointly Modeling Inter- & Intra-Modality Dependencies for Multi-modal Learning (NeurIPS 2024)☆20Updated 8 months ago
- ☆22Updated 3 years ago
- CVPR 2022, Robust Contrastive Learning against Noisy Views☆83Updated 3 years ago
- Implementation of Zorro, Masked Multimodal Transformer, in Pytorch☆97Updated last year
- Implementation for the paper "Reliable Visual Question Answering Abstain Rather Than Answer Incorrectly" (ECCV 2022: https//arxiv.org/abs…☆34Updated 2 years ago
- Code for the paper "Post-hoc Concept Bottleneck Models". Spotlight @ ICLR 2023☆79Updated last year
- ☆160Updated last month
- [ICLR 23 oral] The Modality Focusing Hypothesis: Towards Understanding Crossmodal Knowledge Distillation☆45Updated 2 years ago
- Repository for research works and resources related to model reprogramming <https://arxiv.org/abs/2202.10629>☆61Updated last year
- Official implementation of ORCA proposed in the paper "Cross-Modal Fine-Tuning: Align then Refine"☆71Updated last year
- Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]☆57Updated 7 months ago
- Official Pytorch implementation of "Improved Probabilistic Image-Text Representations" (ICLR 2024)☆57Updated last year
- [NeurIPS 2024 Spotlight] Code for the paper "Flex-MoE: Modeling Arbitrary Modality Combination via the Flexible Mixture-of-Experts"☆57Updated last month
- ☆65Updated 3 years ago
- Code for ICLR'24 workshop ME-FoMo-How Well Does GPT-4V(ision) Adapt to Distribution Shifts? A Preliminary Investigation☆36Updated 8 months ago
- [NeurIPS'24] Multilinear Mixture of Experts: Scalable Expert Specialization through Factorization☆33Updated 9 months ago
- Code for the paper Visual Explanations of Image–Text Representations via Multi-Modal Information Bottleneck Attribution☆53Updated last year
- Symile is a flexible, architecture-agnostic contrastive loss that enables training modality-specific representations for any number of mo…☆36Updated 3 months ago