divyam3897 / I2M2
I2M2: Jointly Modeling Inter- & Intra-Modality Dependencies for Multi-modal Learning (NeurIPS 2024)
☆19Updated 4 months ago
Alternatives and similar repositories for I2M2:
Users that are interested in I2M2 are comparing it to the libraries listed below
- MultiModN – Multimodal, Multi-Task, Interpretable Modular Networks (NeurIPS 2023)☆31Updated last year
- [NeurIPS 2023] Factorized Contrastive Learning: Going Beyond Multi-view Redundancy☆67Updated last year
- Active Learning Helps Pretrained Models Learn the Intended Task (https://arxiv.org/abs/2204.08491) by Alex Tamkin, Dat Nguyen, Salil Desh…☆11Updated 2 years ago
- Official implementation for NeurIPS'23 paper "Geodesic Multi-Modal Mixup for Robust Fine-Tuning"☆32Updated 6 months ago
- Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]☆54Updated 3 months ago
- [NeurIPS 2024] Official implementation of the paper "MambaLRP: Explaining Selective State Space Sequence Models".☆38Updated 4 months ago
- Holistic evaluation of multimodal foundation models☆43Updated 7 months ago
- [NeurIPS 2023, ICMI 2023] Quantifying & Modeling Multimodal Interactions☆70Updated 4 months ago
- Symile is a flexible, architecture-agnostic contrastive loss that enables training modality-specific representations for any number of mo…☆30Updated last month
- ☆48Updated 4 months ago
- Personal implementation of ASIF by Antonio Norelli☆25Updated 10 months ago
- Code for ICLR'24 workshop ME-FoMo-How Well Does GPT-4V(ision) Adapt to Distribution Shifts? A Preliminary Investigation☆35Updated 5 months ago
- Recycling diverse models☆44Updated 2 years ago
- Evaluation and dataset construction code for the CVPR 2025 paper "Vision-Language Models Do Not Understand Negation"☆18Updated 2 weeks ago
- ☆27Updated last year
- Official Code Release for "Diagnosing and Rectifying Vision Models using Language" (ICLR 2023)☆33Updated last year
- Bilingual Medical Mixture of Experts LLM☆31Updated 4 months ago
- This repository is related to 'Intriguing Properties of Hyperbolic Embeddings in Vision-Language Models', published at TMLR (2024), https…☆18Updated 8 months ago
- Official Code for ICLR 2024 Paper: Non-negative Contrastive Learning☆40Updated 11 months ago
- ☆27Updated last month
- Official repo of Progressive Data Expansion: data, code and evaluation☆28Updated last year
- Official Implementation of "Geometric Multimodal Contrastive Representation Learning" (https://arxiv.org/abs/2202.03390)☆28Updated 2 months ago
- Official code for the ICML 2024 paper "The Entropy Enigma: Success and Failure of Entropy Minimization"☆49Updated 10 months ago
- [CVPR 2025] MicroVQA eval and 🤖RefineBot code for "MicroVQA: A Multimodal Reasoning Benchmark for Microscopy-Based Scientific Research"…☆16Updated last week
- More dimensions = More fun☆21Updated 8 months ago
- [NeurIPS 2024 Spotlight] Code for the paper "Flex-MoE: Modeling Arbitrary Modality Combination via the Flexible Mixture-of-Experts"☆36Updated 4 months ago
- This is the official repository for the "Towards Vision-Language Mechanistic Interpretability: A Causal Tracing Tool for BLIP" paper acce…☆21Updated 11 months ago
- MedMax: Mixed-Modal Instruction Tuning for Training Biomedical Assistants☆28Updated 2 months ago
- ☆21Updated 9 months ago
- Discover and Cure: Concept-aware Mitigation of Spurious Correlation (ICML 2023)☆41Updated 11 months ago