Alternatives and similar repositories for Draw-and-Understand

Users that are interested in Draw-and-Understand are comparing it to the libraries listed below

• callsys / ControlCap
  [ECCV 2024] ControlCap: Controllable Region-level Captioning
  ☆77Updated 7 months ago
• eric-ai-lab / GRIT
  Official code for paper "GRIT: Teaching MLLMs to Think with Images"
  ☆91Updated last week
• RupertLuo / VoCoT
  VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models
  ☆65Updated 11 months ago
• JierunChen / Ref-L4
  Evaluation code for Ref-L4, a new REC benchmark in the LMM era
  ☆35Updated 5 months ago
• SY-Xuan / Pink
  Pink: Unveiling the Power of Referential Comprehension for Multi-modal LLMs
  ☆91Updated 5 months ago
• Liuziyu77 / MIA-DPO
  Official implement of MIA-DPO
  ☆58Updated 5 months ago
• PhoenixZ810 / MG-LLaVA
  Official repository for paper MG-LLaVA: Towards Multi-Granularity Visual Instruction Tuning(https://arxiv.org/abs/2406.17770).
  ☆156Updated 8 months ago
• hshjerry / VideoEspresso
  [CVPR 2025 Oral] VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection
  ☆87Updated 2 weeks ago
• TempleX98 / MoVA
  [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context
  ☆159Updated 8 months ago
• alibaba / conv-llava
  ☆115Updated 10 months ago
• Liuziyu77 / RAR
  The official implementation of RAR
  ☆88Updated last year
• mightyzau / RegionBLIP
  ☆58Updated last year
• OpenGVLab / Mono-InternVL
  [CVPR 2025] Mono-InternVL: Pushing the Boundaries of Monolithic Multimodal Large Language Models with Endogenous Visual Pre-training
  ☆47Updated 2 months ago
• ncTimTang / AKS
  [CVPR 2025] Adaptive Keyframe Sampling for Long Video Understanding
  ☆73Updated 2 months ago
• Cooperx521 / PyramidDrop
  (CVPR 2025) PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction
  ☆109Updated 3 months ago
• appletea233 / Temporal-R1
  Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency
  ☆40Updated 2 weeks ago
• yu-rp / VisualPerceptionToken
  ☆86Updated 3 months ago
• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆32Updated 2 months ago
• whwu95 / FreeVA
  FreeVA: Offline MLLM as Training-Free Video Assistant
  ☆60Updated last year
• baaivision / DenseFusion
  DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception
  ☆148Updated 6 months ago
• callsys / DynRefer
  [CVPR 2025] DynRefer: Delving into Region-level Multimodal Tasks via Dynamic Resolution
  ☆51Updated 3 months ago
• mrwu-mac / ControlMLLM
  [NeurIPS2024] Repo for the paper `ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models'
  ☆177Updated 3 weeks ago
• Yxxxb / VoCo-LLaMA
  [CVPR'2025] VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".
  ☆168Updated this week
• BAAI-DCAI / DataOptim
  A collection of visual instruction tuning datasets.
  ☆76Updated last year
• Hon-Wong / ByteVideoLLM
  This is the official repo for ByteVideoLLM/Dynamic-VLM
  ☆20Updated 6 months ago
• TencentARC / SEED-Bench-R1
  ☆84Updated 2 months ago
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆95Updated last year
• HJYao00 / DenseConnector
  【NeurIPS 2024】Dense Connector for MLLMs
  ☆168Updated 8 months ago
• minglllli / CLS-RL
  Think or Not Think: A Study of Explicit Thinking in Rule-Based Visual Reinforcement Fine-Tuning
  ☆49Updated last month
• palchenli / VL-Instruction-Tuning
  ☆91Updated last year