divyam3897 / I2M2Links
I2M2: Jointly Modeling Inter- & Intra-Modality Dependencies for Multi-modal Learning (NeurIPS 2024)
☆19Updated 7 months ago
Alternatives and similar repositories for I2M2
Users that are interested in I2M2 are comparing it to the libraries listed below
Sorting:
- Symile is a flexible, architecture-agnostic contrastive loss that enables training modality-specific representations for any number of mo…☆33Updated 2 months ago
- [NeurIPS 2023] Factorized Contrastive Learning: Going Beyond Multi-view Redundancy☆67Updated last year
- ☆11Updated 2 months ago
- Recycling diverse models☆44Updated 2 years ago
- Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]☆56Updated 5 months ago
- Official Code for ICLR 2024 Paper: Non-negative Contrastive Learning☆45Updated last year
- More dimensions = More fun☆22Updated 10 months ago
- Code for Principal Masked Autoencoders☆27Updated 2 months ago
- ☆22Updated 4 months ago
- [CVPR 2025] MicroVQA eval and 🤖RefineBot code for "MicroVQA: A Multimodal Reasoning Benchmark for Microscopy-Based Scientific Research"…☆20Updated 2 months ago
- Evaluation and dataset construction code for the CVPR 2025 paper "Vision-Language Models Do Not Understand Negation"☆23Updated last month
- Official code for the ICML 2024 paper "The Entropy Enigma: Success and Failure of Entropy Minimization"☆51Updated last year
- Official repo of Progressive Data Expansion: data, code and evaluation☆29Updated last year
- ☆32Updated last year
- [NeurIPS 2024] Official implementation of the paper "MambaLRP: Explaining Selective State Space Sequence Models".☆38Updated 6 months ago
- Holistic evaluation of multimodal foundation models☆47Updated 9 months ago
- Official implementation for NeurIPS'23 paper "Geodesic Multi-Modal Mixup for Robust Fine-Tuning"☆33Updated 8 months ago
- [NeurIPS'24] Official PyTorch implementation for paper "Knowledge Composition using Task Vectors with Learned Anisotropic Scaling"☆20Updated 3 months ago
- ☆27Updated last year
- Discover and Cure: Concept-aware Mitigation of Spurious Correlation (ICML 2023)☆41Updated last year
- Bilingual Medical Mixture of Experts LLM☆31Updated 6 months ago
- Personal implementation of ASIF by Antonio Norelli☆25Updated last year
- [NeurIPS 2023, ICMI 2023] Quantifying & Modeling Multimodal Interactions☆75Updated 7 months ago
- If CLIP Could Talk: Understanding Vision-Language Model Representations Through Their Preferred Concept Descriptions☆17Updated last year
- MedMax: Mixed-Modal Instruction Tuning for Training Biomedical Assistants☆35Updated 3 weeks ago
- Official Implementation of DiffCLIP: Differential Attention Meets CLIP☆30Updated 2 months ago
- Active Learning Helps Pretrained Models Learn the Intended Task (https://arxiv.org/abs/2204.08491) by Alex Tamkin, Dat Nguyen, Salil Desh…☆11Updated 2 years ago
- ☆41Updated 4 months ago
- ☆31Updated 7 months ago
- CatMAE☆14Updated last year