microsoft / LLaVA-Med
Large Language-and-Vision Assistant for Biomedicine, built towards multimodal GPT-4 level capabilities.
☆1,850Updated 3 weeks ago
Alternatives and similar repositories for LLaVA-Med:
Users that are interested in LLaVA-Med are comparing it to the libraries listed below
- BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical Tasks☆635Updated 6 months ago
- Mixture-of-Experts for Large Vision-Language Models☆2,151Updated 4 months ago
- ☆413Updated last year
- The official codes for "PMC-LLaMA: Towards Building Open-source Language Models for Medicine"☆643Updated 9 months ago
- Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks☆2,264Updated this week
- 【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection☆3,236Updated 4 months ago
- [BIONLP@ACL 2024] XrayGPT: Chest Radiographs Summarization using Medical Vision-Language Models.☆507Updated 8 months ago
- Emu Series: Generative Multimodal Models from BAAI☆1,712Updated 7 months ago
- LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills☆739Updated last year
- A Framework of Small-scale Large Multimodal Models☆801Updated this week
- Project Page for "LISA: Reasoning Segmentation via Large Language Model"☆2,172Updated 2 months ago
- Visual Med-Alpaca is an open-source, multi-modal foundation model designed specifically for the biomedical domain, built on the LLaMa-7B.…☆383Updated last year
- Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models side-by-side while providing imag…☆517Updated last year
- ☆3,729Updated 2 months ago
- A collection of resources on applications of multi-modal learning in medical imaging.☆725Updated 3 weeks ago
- A family of lightweight multimodal models.☆1,015Updated 5 months ago
- VisionLLM Series☆1,050Updated 2 months ago
- The official code for "Towards Generalist Foundation Model for Radiology by Leveraging Web-scale 2D&3D Medical Data".☆398Updated 5 months ago
- An Open-source Toolkit for LLM Development☆2,774Updated 3 months ago
- [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses tha…☆866Updated 5 months ago
- ICLR2024 Spotlight: curation/training code, metadata, distribution and pre-trained models for MetaCLIP; CVPR 2024: MoDE: CLIP Data Expert…☆1,422Updated last month
- [EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding☆2,992Updated 10 months ago
- [CVPR 2024] OneLLM: One Framework to Align All Modalities with Language☆633Updated 6 months ago
- InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions☆2,814Updated 3 months ago
- 【ICLR 2024🔥】 Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment☆804Updated last year
- An open-source framework for training large multimodal models.☆3,898Updated 7 months ago
- [NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models"☆520Updated last year
- [ICLR 2025] This is the official repository of our paper "MedTrinity-25M: A Large-scale Multimodal Dataset with Multigranular Annotations…☆311Updated 2 months ago
- Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"☆864Updated 4 months ago
- EMNLP'22 | MedCLIP: Contrastive Learning from Unpaired Medical Images and Texts☆529Updated last year