Alternatives and similar repositories for VisualSketchpad

Users that are interested in VisualSketchpad are comparing it to the libraries listed below

• dongyh20 / Insight-V
  [CVPR2025 Highlight] Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models
  ☆189Updated last month
• DAMO-NLP-SG / multimodal_textbook
  The official repository for "2.5 Years in Class: A Multimodal Textbook for Vision-Language Pretraining"
  ☆153Updated last month
• yihedeng9 / OpenVLThinker
  OpenVLThinker: An Early Exploration to Vision-Language Reasoning via Iterative Self-Improvement
  ☆83Updated last week
• UCSC-VLAA / VLAA-Thinking
  SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models
  ☆107Updated 3 weeks ago
• mbzuai-oryx / LlamaV-o1
  Rethinking Step-by-step Visual Reasoning in LLMs
  ☆293Updated 3 months ago
• TIGER-AI-Lab / Mantis
  Official code for Paper "Mantis: Multi-Image Instruction Tuning" [TMLR2024]
  ☆214Updated last month
• TIGER-AI-Lab / VL-Rethinker
  The official code of "VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning"
  ☆90Updated last week
• IDEA-FinAI / ChartMoE
  [ICLR2025 Oral] ChartMoE: Mixture of Diversely Aligned Expert Connector for Chart Understanding
  ☆78Updated last month
• EvolvingLMMs-Lab / multimodal-sae
  Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.
  ☆128Updated 3 months ago
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆137Updated 6 months ago
• swordlidev / Evaluation-Multimodal-LLMs-Survey
  A Survey on Benchmarks of Multimodal Large Language Models
  ☆103Updated last month
• mathllm / MATH-V
  [NeurIPS 2024] MATH-Vision dataset and code to measure multimodal mathematical reasoning capabilities.
  ☆106Updated this week
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆100Updated 2 months ago
• hewei2001 / ReachQA
  Code & Dataset for Paper: "Distill Visual Chart Reasoning Ability from LLMs to MLLMs"
  ☆53Updated 6 months ago
• SalesforceAIResearch / TACO
  ☆56Updated 2 months ago
• JieyuZ2 / TaskMeAnything
  [NeurIPS 2024] A task generation and model evaluation system for multimodal language models.
  ☆70Updated 5 months ago
• LengSicong / MMR1
  MMR1: Advancing the Frontiers of Multimodal Reasoning
  ☆158Updated 2 months ago
• FreedomIntelligence / LongLLaVA
  LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
  ☆201Updated 4 months ago
• dvlab-research / Prompt-Highlighter
  [CVPR 2024] Prompt Highlighter: Interactive Control for Multi-Modal LLMs
  ☆146Updated 9 months ago
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆374Updated last month
• stanfordmlgroup / ManyICL
  ☆140Updated 11 months ago
• zwq2018 / Multi-modal-Self-instruct
  The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…
  ☆79Updated 3 months ago
• LALBJ / PAI
  [ECCV 2024] Paying More Attention to Image: A Training-Free Method for Alleviating Hallucination in LVLMs
  ☆116Updated 6 months ago
• MMStar-Benchmark / MMStar
  [NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"
  ☆178Updated 7 months ago
• JiuTian-VL / Optimus-1
  [NeurIPS 2024] Official Implementation for Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Tasks
  ☆73Updated last month
• OS-Copilot / OS-Genesis
  Code and data for OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesis
  ☆132Updated last week
• DAMO-NLP-SG / VCD
  [CVPR 2024 Highlight] Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding
  ☆274Updated 7 months ago
• HZQ950419 / Math-LLaVA
  Code for Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models
  ☆84Updated 10 months ago
• InfiMM / Awesome-Multimodal-LLM-for-Math-STEM
  Paper collections of multi-modal LLM for Math/STEM/Code.
  ☆89Updated 3 weeks ago
• Open-DataFlow / Awesome_MLLMs_Reasoning
  ☆95Updated last month