rajesh-lab / symile
Symile is a flexible, architecture-agnostic contrastive loss that enables training modality-specific representations for any number of modalities.
☆29Updated 3 weeks ago
Alternatives and similar repositories for symile:
Users that are interested in symile are comparing it to the libraries listed below
- ☆43Updated 4 months ago
- Holistic evaluation of multimodal foundation models☆42Updated 6 months ago
- "Worse than Random? An Embarrassingly Simple Probing Evaluation of Large Multimodal Models in Medical VQA"☆15Updated 7 months ago
- [NeurIPS 2023] Factorized Contrastive Learning: Going Beyond Multi-view Redundancy☆64Updated last year
- ☆41Updated last month
- ☆41Updated last year
- MultiModN – Multimodal, Multi-Task, Interpretable Modular Networks (NeurIPS 2023)☆30Updated last year
- [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning☆79Updated 9 months ago
- ☆44Updated 4 months ago
- Official implementation for FlexAttention for Efficient High-Resolution Vision-Language Models☆36Updated last month
- HGRN2: Gated Linear RNNs with State Expansion☆52Updated 6 months ago
- MedMax: Mixed-Modal Instruction Tuning for Training Biomedical Assistants☆26Updated 3 weeks ago
- [NeurIPS 2023, ICMI 2023] Quantifying & Modeling Multimodal Interactions☆67Updated 3 months ago
- I2M2: Jointly Modeling Inter- & Intra-Modality Dependencies for Multi-modal Learning (NeurIPS 2024)☆17Updated 3 months ago
- Official implementation of "Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model Evaluation"☆23Updated last month
- ☆37Updated 3 months ago
- [ICCV 2023] ViLLA: Fine-grained vision-language representation learning from real-world data☆39Updated last year
- ☆28Updated 4 months ago
- [WACV 2025] Official implementation of "Online-LoRA: Task-free Online Continual Learning via Low Rank Adaptation" by Xiwen Wei, Guihong L…☆31Updated 3 months ago
- Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]☆51Updated 2 months ago
- BIOMEDICA: An Open Biomedical Image-Caption Archive, Dataset, and Vision-Language Models Derived from Scientific Literature☆41Updated last month
- Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models☆73Updated 5 months ago
- Implementation of Zorro, Masked Multimodal Transformer, in Pytorch☆96Updated last year
- Official PyTorch Implementation for Task Vectors are Cross-Modal☆21Updated 2 months ago
- PyTorch code for "ADEM-VL: Adaptive and Embedded Fusion for Efficient Vision-Language Tuning"☆18Updated 3 months ago
- ☆22Updated 4 months ago
- Implementation of the general framework for AMIE, from the paper "Towards Conversational Diagnostic AI", out of Google Deepmind☆56Updated 5 months ago
- How Good is Google Bard's Visual Understanding? An Empirical Study on Open Challenges☆30Updated last year