rajesh-lab / symileLinks
Symile is a flexible, architecture-agnostic contrastive loss that enables training modality-specific representations for any number of modalities.
☆38Updated 5 months ago
Alternatives and similar repositories for symile
Users that are interested in symile are comparing it to the libraries listed below
Sorting:
- [ICLR 2023] MultiViz: Towards Visualizing and Understanding Multimodal Models☆97Updated last year
- I2M2: Jointly Modeling Inter- & Intra-Modality Dependencies for Multi-modal Learning (NeurIPS 2024)☆22Updated 9 months ago
- [NeurIPS 2023, ICMI 2023] Quantifying & Modeling Multimodal Interactions☆78Updated 9 months ago
- Med-PRM: Medical Reasoning Models with Stepwise, Guideline-verified Process Rewards☆40Updated last month
- [NeurIPS 2023] Factorized Contrastive Learning: Going Beyond Multi-view Redundancy☆70Updated last year
- Expert-level AI radiology report evaluator☆32Updated 4 months ago
- [CVPR 2025] MicroVQA eval and 🤖RefineBot code for "MicroVQA: A Multimodal Reasoning Benchmark for Microscopy-Based Scientific Research"…☆22Updated last month
- ☆25Updated 2 months ago
- Code for the paper "Explain Any Concept: Segment Anything Meets Concept-Based Explanation". Poster @ NeurIPS 2023☆44Updated last year
- MultiModN – Multimodal, Multi-Task, Interpretable Modular Networks (NeurIPS 2023)☆33Updated last year
- ☆20Updated 7 months ago
- [CVPR 2025] BIOMEDICA: An Open Biomedical Image-Caption Archive, Dataset, and Vision-Language Models Derived from Scientific Literature☆76Updated 5 months ago
- [ACL 2025 Findings] "Worse than Random? An Embarrassingly Simple Probing Evaluation of Large Multimodal Models in Medical VQA"☆22Updated 6 months ago
- ☆43Updated 11 months ago
- [CVPR 2025] CheXWorld: Exploring Image World Modeling for Radiograph Representation Learning☆24Updated 4 months ago
- Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]☆57Updated 8 months ago
- MedMax: Mixed-Modal Instruction Tuning for Training Biomedical Assistants☆36Updated 3 months ago
- ☆30Updated 10 months ago
- ☆45Updated 3 weeks ago
- BiomedCLIP data pipeline☆68Updated 7 months ago
- [arXiv'24] EVA-X: A foundation model for general chest X-ray analysis with self-supervised learning☆70Updated last year
- ☆15Updated 2 months ago
- [ICML'25] MMedPO: Aligning Medical Vision-Language Models with Clinical-Aware Multimodal Preference Optimization☆48Updated 2 months ago
- ☆48Updated 6 months ago
- LLaVa Version of RaDialog☆21Updated 3 months ago
- Proposed framework for multimodal data fusion☆16Updated 3 months ago
- INSPECT dataset/benchmark paper, accepted by NeurIPS 2023☆39Updated 3 months ago
- Implementation of the general framework for AMIE, from the paper "Towards Conversational Diagnostic AI", out of Google Deepmind☆67Updated 11 months ago
- The official code to build up dataset PMC-OA☆32Updated last year
- Official code for "TOAST: Transfer Learning via Attention Steering"☆188Updated 2 years ago