Alternatives and similar repositories for VisualSketchpad:

Users that are interested in VisualSketchpad are comparing it to the libraries listed below

• dongyh20 / Insight-V
  [CVPR2025] Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models
  ☆155Updated this week
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆130Updated 4 months ago
• DAMO-NLP-SG / multimodal_textbook
  The official repository for "2.5 Years in Class: A Multimodal Textbook for Vision-Language Pretraining"
  ☆146Updated this week
• stanfordmlgroup / ManyICL
  ☆137Updated 10 months ago
• EvolvingLMMs-Lab / multimodal-sae
  Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.
  ☆120Updated last month
• TIGER-AI-Lab / Mantis
  Official code for Paper "Mantis: Multi-Image Instruction Tuning" [TMLR2024]
  ☆208Updated this week
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆96Updated 3 weeks ago
• JieyuZ2 / TaskMeAnything
  [NeurIPS 2024] A task generation and model evaluation system for multimodal language models.
  ☆70Updated 3 months ago
• MMStar-Benchmark / MMStar
  [NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"
  ☆168Updated 5 months ago
• mathllm / MATH-V
  [NeurIPS2024] MATH-Vision dataset and code to measure multimodal mathematical reasoning capabilities.
  ☆94Updated last week
• para-lost / AutoPresent
  Code for the paper "AutoPresent: Designing Structured Visuals From Scratch" (CVPR 2025)
  ☆60Updated 3 weeks ago
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆65Updated 9 months ago
• mbzuai-oryx / LlamaV-o1
  Rethinking Step-by-step Visual Reasoning in LLMs
  ☆277Updated last month
• swordlidev / Evaluation-Multimodal-LLMs-Survey
  A Survey on Benchmarks of Multimodal Large Language Models
  ☆90Updated this week
• zwq2018 / Multi-modal-Self-instruct
  The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…
  ☆73Updated last month
• nickjiang2378 / vl-interp
  Official Pytorch implementation of "Interpreting and Editing Vision-Language Representations to Mitigate Hallucinations" (ICLR '25)
  ☆62Updated 2 weeks ago
• yuweihao / MM-Vet
  MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)
  ☆290Updated 2 months ago
• InfiMM / Awesome-Multimodal-LLM-for-Math-STEM
  Paper collections of multi-modal LLM for Math/STEM/Code.
  ☆81Updated this week
• tianyi-lab / HallusionBench
  [CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(…
  ☆273Updated 4 months ago
• SalesforceAIResearch / TACO
  ☆50Updated last month
• hewei2001 / ReachQA
  Code & Dataset for Paper: "Distill Visual Chart Reasoning Ability from LLMs to MLLMs"
  ☆50Updated 4 months ago
• yfzhang114 / SliME
  ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models
  ☆154Updated 2 months ago
• luogen1996 / LLaVA-HR
  [ICLR2025] LLaVA-HR: High-Resolution Large Language-Vision Assistant
  ☆234Updated 7 months ago
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆59Updated 8 months ago
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆50Updated 5 months ago
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆368Updated this week
• Dongping-Chen / MLLM-Judge
  [ICML 2024 Oral] Official code repository for MLLM-as-a-Judge.
  ☆65Updated last month
• zzxslp / SoM-LLaVA
  [COLM-2024] List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs
  ☆140Updated 7 months ago
• kongds / E5-V
  E5-V: Universal Embeddings with Multimodal Large Language Models
  ☆234Updated 3 months ago
• princeton-nlp / CharXiv
  [NeurIPS 2024] CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs
  ☆99Updated 2 months ago