Alternatives and similar repositories for world-to-words

Users that are interested in world-to-words are comparing it to the libraries listed below

• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆91Updated last year
• mlfoundations / VisIT-Bench
  ☆50Updated 2 years ago
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆69Updated last year
• YiyangZhou / CSR
  [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models
  ☆84Updated 2 months ago
• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆58Updated last year
• si0wang / ViCrit
  ☆24Updated 6 months ago
• yuecao0119 / MMInstruct
  [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…
  ☆61Updated last year
• zwq2018 / Multi-modal-Self-instruct
  The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…
  ☆85Updated 11 months ago
• DCDmllm / MorphTokens
  ☆43Updated last year
• shiqichen17 / VLM_Merging
  Github repository for "Bring Reason to Vision: Understanding Perception and Reasoning through Model Merging" (ICML 2025)
  ☆86Updated 3 months ago
• shiqichen17 / AdaptVis
  Github repository for "Why Is Spatial Reasoning Hard for VLMs? An Attention Mechanism Perspective on Focus Areas" (ICML 2025)
  ☆67Updated 8 months ago
• si0wang / VisVM
  ☆46Updated last year
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated 2 years ago
• yuhui-zh15 / AutoConverter
  Official implementation of "Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model Evaluation" (CVPR 202…
  ☆40Updated 7 months ago
• zeyofu / ReFocus_Code
  Codes for ReFocus: Visual Editing as a Chain of Thought for Structured Image Understanding [ICML 2025]]
  ☆44Updated 5 months ago
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆72Updated last year
• amitakamath / whatsup_vlms
  Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".
  ☆68Updated last year
• xiangyu-mm / EasyGen
  The official code for paper "EasyGen: Easing Multimodal Generation with a Bidirectional Conditional Diffusion Model and LLMs"
  ☆74Updated last year
• isekai-portal / Link-Context-Learning
  ☆100Updated last year
• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆41Updated 3 weeks ago
• gzcch / Bingo
  ☆55Updated last year
• CASIA-IVA-Lab / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆53Updated 10 months ago
• waltonfuture / MM-UPT
  [NeurIPS 2025] Unsupervised Post-Training for Multi-Modal LLM Reasoning via GRPO
  ☆73Updated 2 months ago
• yale-nlp / TOMATO
  ☆35Updated last year
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆121Updated 11 months ago
• zkx06111 / ReDiffusion
  ☆17Updated 2 years ago
• AtsuMiyai / UPD
  [ACL2025] Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Models
  ☆79Updated 7 months ago
• luka-group / vlm-knowledge-conflict
  Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."
  ☆50Updated last year
• zeyofu / BLINK_Benchmark
  This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…
  ☆153Updated 3 months ago
• RifleZhang / LLaVA-Reasoner-DPO
  ☆109Updated last year