Alternatives and similar repositories for VisualSketchpad:

Users that are interested in VisualSketchpad are comparing it to the libraries listed below

• DAMO-NLP-SG / multimodal_textbook
  The official repository for "2.5 Years in Class: A Multimodal Textbook for Vision-Language Pretraining"
  ☆140Updated 3 weeks ago
• dongyh20 / Insight-V
  Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models
  ☆128Updated last month
• MBZUAI-LLM / web2code
  Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs
  ☆73Updated 3 months ago
• para-lost / AutoPresent
  Code for the paper "AutoPresent: Designing Structured Visuals From Scratch"
  ☆48Updated last month
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆127Updated 3 months ago
• TIGER-AI-Lab / Mantis
  Official code for Paper "Mantis: Multi-Image Instruction Tuning" (TMLR2024)
  ☆197Updated this week
• SHI-Labs / CuMo
  CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts
  ☆139Updated 8 months ago
• JieyuZ2 / TaskMeAnything
  [NeurIPS 2024] A task generation and model evaluation system for multimodal language models.
  ☆63Updated 2 months ago
• EvolvingLMMs-Lab / multimodal-sae
  Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.
  ☆104Updated 3 weeks ago
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆63Updated 8 months ago
• OS-Copilot / OS-Genesis
  Code and data for OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesis
  ☆94Updated 3 weeks ago
• mbzuai-oryx / LlamaV-o1
  Rethinking Step-by-step Visual Reasoning in LLMs
  ☆240Updated 3 weeks ago
• Dongping-Chen / GUI-World
  (ICLR 2025) The Official Code Repository for GUI-World.
  ☆46Updated last month
• stanfordmlgroup / ManyICL
  ☆134Updated 8 months ago
• swordlidev / Evaluation-Multimodal-LLMs-Survey
  A Survey on Benchmarks of Multimodal Large Language Models
  ☆84Updated last month
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆59Updated 7 months ago
• SalesforceAIResearch / TACO
  ☆45Updated last month
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆86Updated last month
• junyangwang0410 / AMBER
  An LLM-free Multi-dimensional Benchmark for Multi-modal Hallucination Evaluation
  ☆111Updated last year
• HZQ950419 / Math-LLaVA
  Code for Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models
  ☆76Updated 7 months ago
• RUCBM / GUICourse
  GUICourse: From General Vision Langauge Models to Versatile GUI Agents
  ☆98Updated 6 months ago
• mathllm / MATH-V
  MATH-Vision dataset and code to measure Multimodal Mathematical Reasoning capabilities.
  ☆85Updated 4 months ago
• dvlab-research / Prompt-Highlighter
  [CVPR 2024] Prompt Highlighter: Interactive Control for Multi-Modal LLMs
  ☆138Updated 6 months ago
• zengxingchen / ChartQA-MLLM
  [IEEE VIS 2024] LLaVA-Chart: Advancing Multimodal Large Language Models in Chart Question Answering with Visualization-Referenced Instruc…
  ☆61Updated 3 weeks ago
• UCSC-VLAA / Recap-DataComp-1B
  This is the official repository of our paper "What If We Recaption Billions of Web Images with LLaMA-3 ?"
  ☆128Updated 8 months ago
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆48Updated 3 months ago
• MingLiiii / Layer_Gradient
  What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective
  ☆58Updated 3 months ago
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆94Updated last year
• OSU-NLP-Group / UGround
  [ICLR'25 Oral] UGround: Universal GUI Visual Grounding for GUI Agents
  ☆160Updated this week
• FreedomIntelligence / LongLLaVA
  LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
  ☆189Updated last month