Alternatives and similar repositories for Draw-and-Understand

Users that are interested in Draw-and-Understand are comparing it to the libraries listed below

• Liuziyu77 / RAR
  The official implementation of RAR
  ☆88Updated last year
• TempleX98 / MoVA
  [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context
  ☆163Updated 9 months ago
• JierunChen / Ref-L4
  Evaluation code for Ref-L4, a new REC benchmark in the LMM era
  ☆37Updated 6 months ago
• SY-Xuan / Pink
  Pink: Unveiling the Power of Referential Comprehension for Multi-modal LLMs
  ☆91Updated 5 months ago
• alibaba / conv-llava
  ☆115Updated 11 months ago
• callsys / ControlCap
  [ECCV 2024] ControlCap: Controllable Region-level Captioning
  ☆77Updated 8 months ago
• wusize / F-LMM
  [CVPR2025] Code Release of F-LMM: Grounding Frozen Large Multimodal Models
  ☆96Updated last month
• baaivision / DenseFusion
  DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception
  ☆147Updated 7 months ago
• hshjerry / VideoEspresso
  [CVPR 2025 Oral] VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection
  ☆93Updated last month
• eric-ai-lab / GRIT
  Official code for paper "GRIT: Teaching MLLMs to Think with Images"
  ☆105Updated 3 weeks ago
• OpenGVLab / Mono-InternVL
  [CVPR 2025] Mono-InternVL: Pushing the Boundaries of Monolithic Multimodal Large Language Models with Endogenous Visual Pre-training
  ☆48Updated 3 months ago
• PhoenixZ810 / MG-LLaVA
  Official repository for paper MG-LLaVA: Towards Multi-Granularity Visual Instruction Tuning(https://arxiv.org/abs/2406.17770).
  ☆156Updated 9 months ago
• whwu95 / FreeVA
  FreeVA: Offline MLLM as Training-Free Video Assistant
  ☆59Updated last year
• Hon-Wong / Elysium
  [ECCV 2024] Elysium: Exploring Object-level Perception in Videos via MLLM
  ☆77Updated 8 months ago
• ant-research / DreamLIP
  [ECCV 2024] Official PyTorch implementation of DreamLIP: Language-Image Pre-training with Long Captions
  ☆134Updated 2 months ago
• zzxslp / SoM-LLaVA
  [COLM-2024] List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs
  ☆144Updated 10 months ago
• lizhou-cs / mglmm
  ☆31Updated 9 months ago
• wuw2019 / LoTLIP
  [NeurIPS 2024] Official PyTorch implementation of LoTLIP: Improving Language-Image Pre-training for Long Text Understanding
  ☆43Updated 6 months ago
• mrwu-mac / ControlMLLM
  [NeurIPS2024] Repo for the paper `ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models'
  ☆184Updated this week
• Liuziyu77 / MIA-DPO
  Official implement of MIA-DPO
  ☆59Updated 5 months ago
• HJYao00 / DenseConnector
  【NeurIPS 2024】Dense Connector for MLLMs
  ☆171Updated 9 months ago
• MME-Benchmarks / MME-RealWorld
  ✨✨ [ICLR 2025] MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?
  ☆128Updated 4 months ago
• RUCAIBox / ComVint
  The official GitHub page for ''What Makes for Good Visual Instructions? Synthesizing Complex Visual Reasoning Instructions for Visual Ins…
  ☆19Updated last year
• Shengcao-Cao / groundLMM
  Emerging Pixel Grounding in Large Multimodal Models Without Grounding Supervision
  ☆41Updated 3 months ago
• AILab-CVC / VL-GPT
  VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation
  ☆86Updated 10 months ago
• foundation-multimodal-models / CAPTURE
  ☆66Updated 11 months ago
• BAAI-DCAI / DataOptim
  A collection of visual instruction tuning datasets.
  ☆76Updated last year
• yuhui-zh15 / VLMClassifier
  Official implementation of "Why are Visually-Grounded Language Models Bad at Image Classification?" (NeurIPS 2024)
  ☆85Updated 8 months ago
• palchenli / VL-Instruction-Tuning
  ☆91Updated last year
• Yxxxb / VoCo-LLaMA
  [CVPR'2025] VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".
  ☆176Updated 3 weeks ago