Alternatives and similar repositories for world-to-words

Users that are interested in world-to-words are comparing it to the libraries listed below

• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆89Updated last year
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆70Updated last year
• zeyofu / ReFocus_Code
  Codes for ReFocus: Visual Editing as a Chain of Thought for Structured Image Understanding [ICML 2025]]
  ☆43Updated 4 months ago
• mlfoundations / VisIT-Bench
  ☆50Updated 2 years ago
• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆54Updated last year
• shiqichen17 / VLM_Merging
  Github repository for "Bring Reason to Vision: Understanding Perception and Reasoning through Model Merging" (ICML 2025)
  ☆81Updated 2 months ago
• yuecao0119 / MMInstruct
  [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…
  ☆59Updated last year
• YiyangZhou / CSR
  [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models
  ☆80Updated 3 weeks ago
• zwq2018 / Multi-modal-Self-instruct
  The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…
  ☆84Updated 9 months ago
• si0wang / ViCrit
  ☆24Updated 5 months ago
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆148Updated last year
• thunlp / DeepPerception
  DeepPerception: Advancing R1-like Cognitive Visual Perception in MLLMs for Knowledge-Intensive Visual Grounding
  ☆65Updated 5 months ago
• OoDBag / VisTA
  VisualToolAgent (VisTA): A Reinforcement Learning Framework for Visual Tool Selection
  ☆20Updated 5 months ago
• amitakamath / whatsup_vlms
  Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".
  ☆65Updated last year
• Lookuz / VidHal
  Codebase for VidHal: Benchmarking Hallucinations in Vision LLMs
  ☆14Updated 7 months ago
• DCDmllm / MorphTokens
  ☆43Updated last year
• gzcch / Bingo
  ☆55Updated last year
• declare-lab / LLM-PuzzleTest
  This repository is maintained to release dataset and models for multimodal puzzle reasoning.
  ☆111Updated 8 months ago
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated 2 years ago
• Hxyou / IdealGPT
  Official Code of IdealGPT
  ☆35Updated 2 years ago
• waltonfuture / MM-UPT
  [NeurIPS 2025] Unsupervised Post-Training for Multi-Modal LLM Reasoning via GRPO
  ☆64Updated 3 weeks ago
• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆33Updated 2 years ago
• Letian2003 / C-VQA
  Counterfactual Reasoning VQA Dataset
  ☆25Updated 2 years ago
• shiqichen17 / AdaptVis
  Github repository for "Why Is Spatial Reasoning Hard for VLMs? An Attention Mechanism Perspective on Focus Areas" (ICML 2025)
  ☆53Updated 6 months ago
• si0wang / VisVM
  ☆46Updated 10 months ago
• pipilurj / bootstrapped-preference-optimization-BPO
  code for "Strengthening Multimodal Large Language Model with Bootstrapped Preference Optimization"
  ☆59Updated last year
• isekai-portal / Link-Context-Learning
  ☆100Updated last year
• xiangyu-mm / EasyGen
  The official code for paper "EasyGen: Easing Multimodal Generation with a Bidirectional Conditional Diffusion Model and LLMs"
  ☆73Updated last year
• UW-Madison-Lee-Lab / CoBSAT
  Implementation and dataset for paper "Can MLLMs Perform Text-to-Image In-Context Learning?"
  ☆41Updated 5 months ago
• yunfeixie233 / ViGaL
  ☆62Updated last month