Alternatives and similar repositories for world-to-words

Users that are interested in world-to-words are comparing it to the libraries listed below

• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆86Updated last year
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆69Updated last year
• si0wang / ViCrit
  ☆18Updated last month
• mlfoundations / VisIT-Bench
  ☆50Updated last year
• zeyofu / ReFocus_Code
  Codes for ReFocus: Visual Editing as a Chain of Thought for Structured Image Understanding [ICML 2025]]
  ☆35Updated last week
• xiangyu-mm / EasyGen
  The official code for paper "EasyGen: Easing Multimodal Generation with a Bidirectional Conditional Diffusion Model and LLMs"
  ☆74Updated 7 months ago
• amitakamath / whatsup_vlms
  Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".
  ☆54Updated last year
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated 2 years ago
• YiyangZhou / CSR
  [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models
  ☆76Updated last year
• zwq2018 / Multi-modal-Self-instruct
  The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…
  ☆79Updated 5 months ago
• luka-group / vlm-knowledge-conflict
  Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."
  ☆42Updated 8 months ago
• si0wang / VisVM
  ☆45Updated 6 months ago
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆66Updated last year
• yuecao0119 / MMInstruct
  [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…
  ☆55Updated 8 months ago
• gzcch / Bingo
  ☆55Updated last year
• yuhui-zh15 / AutoConverter
  Official implementation of "Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model Evaluation" (CVPR 202…
  ☆32Updated last month
• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆33Updated last year
• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆47Updated 8 months ago
• zkx06111 / ReDiffusion
  ☆16Updated last year
• shiqichen17 / VLM_Merging
  Github repository for "Bring Reason to Vision: Understanding Perception and Reasoning through Model Merging" (ICML 2025)
  ☆63Updated last month
• microsoft / x-reasoner
  X-Reasoner: Towards Generalizable Reasoning Across Modalities and Domains
  ☆46Updated 2 months ago
• DCDmllm / MorphTokens
  ☆44Updated last year
• SivanDoveh / DAC
  Repository for the paper: dense and aligned captions (dac) promote compositional reasoning in vl models
  ☆27Updated last year
• bigai-nlco / LatentSeek
  Official Repository of LatentSeek
  ☆54Updated last month
• locuslab / llava-token-compression
  ☆42Updated 8 months ago
• SUSTechBruce / SRPO_MLLMs
  Main source code of SRPO framework.
  ☆29Updated 3 weeks ago
• Letian2003 / C-VQA
  Counterfactual Reasoning VQA Dataset
  ☆25Updated last year
• zeyofu / BLINK_Benchmark
  This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…
  ☆130Updated last year
• thunlp / DeepPerception
  DeepPerception: Advancing R1-like Cognitive Visual Perception in MLLMs for Knowledge-Intensive Visual Grounding
  ☆65Updated last month
• UW-Madison-Lee-Lab / CoBSAT
  Implementation and dataset for paper "Can MLLMs Perform Text-to-Image In-Context Learning?"
  ☆39Updated last month