Victorwz / LLaVA-Llama-3
Reproduction of LLaVA-v1.5 based on Llama-3-8b LLM backbone.
☆65Updated 6 months ago
Alternatives and similar repositories for LLaVA-Llama-3:
Users that are interested in LLaVA-Llama-3 are comparing it to the libraries listed below
- 【NeurIPS 2024】Dense Connector for MLLMs☆159Updated 6 months ago
- ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models☆155Updated 3 months ago
- Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*☆100Updated last month
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆42Updated 9 months ago
- ☆115Updated 8 months ago
- MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteria☆69Updated 6 months ago
- ☆55Updated 8 months ago
- The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…☆76Updated 2 months ago
- Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".☆52Updated last week
- ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Exploration☆30Updated 3 months ago
- Enhancing Large Vision Language Models with Self-Training on Image Comprehension.☆65Updated 10 months ago
- A collection of visual instruction tuning datasets.☆76Updated last year
- ☆73Updated 3 months ago
- ☆133Updated last year
- CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts☆147Updated 10 months ago
- [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context☆154Updated 7 months ago
- [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"☆132Updated 5 months ago
- ☆63Updated last year
- Official code for Paper "Mantis: Multi-Image Instruction Tuning" [TMLR2024]☆214Updated last month
- [CVPR'2025] VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".☆153Updated last month
- Official PyTorch Implementation of MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced …☆66Updated 5 months ago
- ☆51Updated last year
- ☆45Updated 3 months ago
- ☆73Updated last year
- Official repo for StableLLAVA☆95Updated last year
- Official repository of MMDU dataset☆89Updated 6 months ago
- Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model☆260Updated 10 months ago
- [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …☆111Updated 3 weeks ago
- The huggingface implementation of Fine-grained Late-interaction Multi-modal Retriever.☆85Updated 2 months ago
- Official implementation of the Law of Vision Representation in MLLMs☆154Updated 5 months ago