[COLM-2024] List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs
☆147Aug 23, 2024Updated 2 years ago
Alternatives and similar repositories for SoM-LLaVA
Users that are interested in SoM-LLaVA are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [arXiv 2023] Set-of-Mark Prompting for GPT-4V and LMMs☆1,572Aug 19, 2024Updated 2 years ago
- Official code for Paper "Mantis: Multi-Image Instruction Tuning" [TMLR 2024 Best Paper]☆243Jan 3, 2026Updated 10 months ago
- When do we not need larger vision models?☆420Feb 8, 2025Updated last year
- [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts☆338Jul 17, 2024Updated 2 years ago
- LLaVA-UHD v3: Progressive Visual Compression for Efficient Native-Resolution Encoding in MLLMs☆426Jul 6, 2026Updated 4 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Official Implementation for "MyVLM: Personalizing VLMs for User-Specific Queries" (ECCV 2024)☆189Jul 5, 2024Updated 2 years ago
- [NeurIPS2023] Official implementation of the paper "Large Language Models are Visual Reasoning Coordinators"☆105Nov 9, 2023Updated 2 years ago
- [ECCV’24] Official repository for "BEAF: Observing Before-AFter Changes to Evaluate Hallucination in Vision-language Models"☆22Mar 26, 2025Updated last year
- [ECCV-24] This is the official implementation of the paper "SEGIC: Unleashing the Emergent Correspondence for In-Context Segmentation".☆29Oct 13, 2024Updated 2 years ago
- DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception☆161Dec 6, 2024Updated last year
- [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback☆311Sep 11, 2024Updated 2 years ago
- [ICLR2025] Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want☆98Dec 1, 2025Updated 11 months ago
- [NeurIPS 2024] Official implementation of the paper "Interfacing Foundation Models' Embeddings"☆133Aug 21, 2024Updated 2 years ago
- ☆19Oct 28, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- LLaVA-Interactive-Demo☆382Jul 25, 2024Updated 2 years ago
- ☆12Oct 6, 2026Updated last month
- Visual self-questioning for large vision-language assistant.☆44Jul 23, 2025Updated last year
- [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context☆174Sep 25, 2024Updated 2 years ago
- ☆364Jan 27, 2024Updated 2 years ago
- [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…☆129Nov 25, 2024Updated last year
- PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"☆715Jan 7, 2024Updated 2 years ago
- Official repository for the paper PLLaVA☆669Jul 28, 2024Updated 2 years ago
- [NeurIPS 2025] The official repository of "Inst-IT: Boosting Multimodal Instance Understanding via Explicit Visual Prompt Instruction Tun…☆40Feb 20, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆46Dec 30, 2024Updated last year
- ☆399Jul 29, 2024Updated 2 years ago
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆44Jun 28, 2024Updated 2 years ago
- A instruction data generation system for multimodal language models.☆37Jan 31, 2025Updated last year
- Official repo for "FineCops-Ref: A new Dataset and Task for Fine-Grained Compositional Referring Expression Comprehension." EMNLP 2024☆13Oct 11, 2025Updated last year
- ☆12Jan 7, 2023Updated 3 years ago
- [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…☆94Jun 17, 2024Updated 2 years ago
- TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Models☆41Nov 10, 2024Updated last year
- [CVPR'25 highlight] RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthiness☆462May 14, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- [CVPR 2024] VCoder: Versatile Vision Encoders for Multimodal Large Language Models☆278Apr 17, 2024Updated 2 years ago
- [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses tha…☆969Sep 5, 2026Updated 2 months ago
- Evaluate Multimodal LLMs as Embodied Agents☆62Feb 14, 2025Updated last year
- Unifying Specialized Visual Encoders for Video Language Models☆25Nov 22, 2025Updated 11 months ago
- Official implementation of TDC.☆15Jul 22, 2025Updated last year
- Cambrian-1 is a family of multimodal LLMs with a vision-centric design.☆2,014Nov 7, 2025Updated last year
- 🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)☆844Sep 5, 2026Updated 2 months ago