zzxslp / SoM-LLaVA
[COLM-2024] List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs
☆134Updated 5 months ago
Alternatives and similar repositories for SoM-LLaVA:
Users that are interested in SoM-LLaVA are comparing it to the libraries listed below
- Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models☆128Updated last month
- ☆132Updated last year
- This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…☆115Updated 7 months ago
- VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation☆85Updated 5 months ago
- ☆137Updated 3 months ago
- [ECCV2024] Official code implementation of Merlin: Empowering Multimodal LLMs with Foresight Minds☆89Updated 7 months ago
- ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback☆59Updated 5 months ago
- Official repo for StableLLAVA☆94Updated last year
- [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"☆127Updated 3 months ago
- [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …☆98Updated last week
- [NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"☆165Updated 4 months ago
- Official implementation of the Law of Vision Representation in MLLMs☆149Updated 2 months ago
- [NeurIPS 2024] Official code for HourVideo: 1-Hour Video Language Understanding☆62Updated last month
- EVE Series: Encoder-Free Vision-Language Models from BAAI☆290Updated this week
- Official code for Paper "Mantis: Multi-Image Instruction Tuning" (TMLR2024)☆197Updated this week
- CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts☆139Updated 8 months ago
- Official implementation for "A Simple LLM Framework for Long-Range Video Question-Answering"☆92Updated 3 months ago
- ☆132Updated 4 months ago
- [ICLR2025] Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want☆65Updated 2 weeks ago
- [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision☆59Updated 7 months ago
- PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models☆250Updated last year
- VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".☆95Updated 7 months ago
- SVIT: Scaling up Visual Instruction Tuning☆164Updated 7 months ago
- ☆68Updated 7 months ago
- ☆84Updated last month
- Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimization☆81Updated last year
- [Neurips'24 Spotlight] Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought …☆227Updated last month
- Official implementation of "Why are Visually-Grounded Language Models Bad at Image Classification?" (NeurIPS 2024)☆68Updated 3 months ago
- [ICLR2025] LLaVA-HR: High-Resolution Large Language-Vision Assistant☆226Updated 6 months ago