Alternatives and similar repositories for world-to-words

Users that are interested in world-to-words are comparing it to the libraries listed below

• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆87Updated last year
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆70Updated last year
• yuhui-zh15 / AutoConverter
  Official implementation of "Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model Evaluation" (CVPR 202…
  ☆33Updated 3 months ago
• si0wang / ViCrit
  ☆23Updated 2 months ago
• shiqichen17 / VLM_Merging
  Github repository for "Bring Reason to Vision: Understanding Perception and Reasoning through Model Merging" (ICML 2025)
  ☆72Updated 2 months ago
• si0wang / VisVM
  ☆45Updated 8 months ago
• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆48Updated 9 months ago
• DCDmllm / MorphTokens
  ☆44Updated last year
• mlfoundations / VisIT-Bench
  ☆50Updated last year
• yuecao0119 / MMInstruct
  [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…
  ☆55Updated 9 months ago
• YiyangZhou / CSR
  [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models
  ☆79Updated last year
• OoDBag / VisTA
  VisualToolAgent (VisTA): A Reinforcement Learning Framework for Visual Tool Selection
  ☆19Updated 3 months ago
• zeyofu / ReFocus_Code
  Codes for ReFocus: Visual Editing as a Chain of Thought for Structured Image Understanding [ICML 2025]]
  ☆37Updated last month
• RifleZhang / LLaVA-Reasoner-DPO
  ☆86Updated 7 months ago
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated 2 years ago
• amitakamath / whatsup_vlms
  Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".
  ☆57Updated last year
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆69Updated last year
• zwq2018 / Multi-modal-Self-instruct
  The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…
  ☆83Updated 7 months ago
• Lookuz / VidHal
  Codebase for VidHal: Benchmarking Hallucinations in Vision LLMs
  ☆13Updated 4 months ago
• findalexli / mllm-dpo
  [ACL 2024] Multi-modal preference alignment remedies regression of visual instruction tuning on language model
  ☆46Updated 9 months ago
• luka-group / vlm-knowledge-conflict
  Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."
  ☆45Updated 10 months ago
• gzcch / Bingo
  ☆55Updated last year
• Hxyou / IdealGPT
  Official Code of IdealGPT
  ☆35Updated last year
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆146Updated 9 months ago
• Yuqifan1117 / HalluciDoctor
  HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)
  ☆48Updated last year
• yfzhang114 / LLaVA-Align
  [ACM Multimedia 2025] This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual…
  ☆82Updated 6 months ago
• Letian2003 / C-VQA
  Counterfactual Reasoning VQA Dataset
  ☆25Updated last year
• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆33Updated 2 years ago
• locuslab / llava-token-compression
  ☆43Updated 9 months ago
• xiangyu-mm / EasyGen
  The official code for paper "EasyGen: Easing Multimodal Generation with a Bidirectional Conditional Diffusion Model and LLMs"
  ☆74Updated 9 months ago