divyam3897 / I2M2Links
I2M2: Jointly Modeling Inter- & Intra-Modality Dependencies for Multi-modal Learning (NeurIPS 2024)
☆22Updated last year
Alternatives and similar repositories for I2M2
Users that are interested in I2M2 are comparing it to the libraries listed below
Sorting:
- [NeurIPS 2023, ICMI 2023] Quantifying & Modeling Multimodal Interactions☆82Updated last year
 - [ICLR 2023] MultiViz: Towards Visualizing and Understanding Multimodal Models☆97Updated last year
 - [NeurIPS 2023] Factorized Contrastive Learning: Going Beyond Multi-view Redundancy☆73Updated last year
 - Symile is a flexible, architecture-agnostic contrastive loss that enables training modality-specific representations for any number of mo…☆42Updated 7 months ago
 - MedMax: Mixed-Modal Instruction Tuning for Training Biomedical Assistants☆39Updated last month
 - [CVPR 2025] CheXWorld: Exploring Image World Modeling for Radiograph Representation Learning☆27Updated 6 months ago
 - Sparse Linear Concept Embeddings☆115Updated 7 months ago
 - (ICML 2023) Discover and Cure: Concept-aware Mitigation of Spurious Correlation☆42Updated last year
 - Official implementation for NeurIPS'23 paper "Geodesic Multi-Modal Mixup for Robust Fine-Tuning"☆35Updated last year
 - [ICLR 23] A new framework to transform any neural networks into an interpretable concept-bottleneck-model (CBM) without needing labeled c…☆119Updated last year
 - Expert-level AI radiology report evaluator☆34Updated 7 months ago
 - Repository for our NeurIPS 2022 paper "Concept Embedding Models", our NeurIPS 2023 paper "Learning to Receive Help", and our ICML 2025 pa…☆69Updated 3 weeks ago
 - [CVPR 2025] Custom Open CLIP repo to train biomedical CLIP models☆26Updated 7 months ago
 - [CVPR 2025] MicroVQA eval and 🤖RefineBot code for "MicroVQA: A Multimodal Reasoning Benchmark for Microscopy-Based Scientific Research"…☆25Updated 2 weeks ago
 - [EMNLP 2025] Med-PRM: Medical Reasoning Models with Stepwise, Guideline-verified Process Rewards☆45Updated last month
 - [ NeurIPS 2023 ] Official Codebase for "Aligning Synthetic Medical Images with Clinical Knowledge using Human Feedback"☆19Updated 2 years ago
 - Holistic evaluation of multimodal foundation models☆47Updated last year
 - Accompanying code for "Analyzing Vision Tranformers in Class Embedding Space" (NeurIPS '23)☆14Updated last year
 - [NeurIPS 2024 Spotlight] Code for the paper "Flex-MoE: Modeling Arbitrary Modality Combination via the Flexible Mixture-of-Experts"☆66Updated 4 months ago
 - Code for the paper "Post-hoc Concept Bottleneck Models". Spotlight @ ICLR 2023☆84Updated last year
 - Code for the paper "Explain Any Concept: Segment Anything Meets Concept-Based Explanation". Poster @ NeurIPS 2023☆45Updated last year
 - Official Implementation of "Geometric Multimodal Contrastive Representation Learning" (https://arxiv.org/abs/2202.03390)☆28Updated 9 months ago
 - Active Learning in the era of Foundation Models☆10Updated 6 months ago
 - MultiModN – Multimodal, Multi-Task, Interpretable Modular Networks (NeurIPS 2023)☆34Updated 2 years ago
 - ☆71Updated 4 months ago
 - Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]☆60Updated 10 months ago
 - Official code repository of paper titled "Test-Time Low Rank Adaptation via Confidence Maximization for Zero-Shot Generalization of Visio…☆29Updated 5 months ago
 - [NeurIPS'24] CARES: A Comprehensive Benchmark of Trustworthiness in Medical Vision Language Models☆77Updated 10 months ago
 - [NeurIPS 2024] RaVL: Discovering and Mitigating Spurious Correlations in Fine-Tuned Vision-Language Models☆28Updated 11 months ago
 - Implementation of the general framework for AMIE, from the paper "Towards Conversational Diagnostic AI", out of Google Deepmind☆68Updated last year