Alternatives and similar repositories for world-to-words

Users that are interested in world-to-words are comparing it to the libraries listed below

• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆66Updated 11 months ago
• showlab / VisInContext
  Official implementation of Leveraging Visual Tokens for Extended Text Contexts in Multi-Modal Learning
  ☆15Updated 6 months ago
• RifleZhang / LLaVA-Reasoner-DPO
  ☆75Updated 4 months ago
• Yangyi-Chen / CoTConsistency
  The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".
  ☆32Updated last year
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆83Updated last year
• yaolinli / DeCo
  ☆35Updated 10 months ago
• John-AI-Lab / NoisyRollout
  NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation
  ☆54Updated last week
• yuhui-zh15 / AutoConverter
  Official implementation of "Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model Evaluation" (CVPR 202…
  ☆25Updated 2 months ago
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆62Updated 10 months ago
• Hxyou / IdealGPT
  Official Code of IdealGPT
  ☆35Updated last year
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆47Updated 2 months ago
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated last year
• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆32Updated last year
• si0wang / VisVM
  ☆41Updated 4 months ago
• yuecao0119 / MMInstruct
  [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…
  ☆51Updated 6 months ago
• showlab / MovieSeq
  [ECCV 2024] Learning Video Context as Interleaved Multimodal Sequences
  ☆39Updated 2 months ago
• lscpku / VITATECS
  ☆18Updated 10 months ago
• YiyangZhou / CSR
  [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models
  ☆73Updated 11 months ago
• mlfoundations / VisIT-Bench
  ☆51Updated last year
• Yuqifan1117 / HalluciDoctor
  HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)
  ☆45Updated 10 months ago
• Wang-ML-Lab / multimodal-needle-in-a-haystack
  [NAACL 2025 Oral] Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Language Models
  ☆43Updated 2 weeks ago
• yuezih / less-is-more
  Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)
  ☆49Updated 6 months ago
• microsoft / x-reasoner
  X-Reasoner: Towards Generalizable Reasoning Across Modalities and Domains
  ☆40Updated last week
• findalexli / mllm-dpo
  [ACL 2024] Multi-modal preference alignment remedies regression of visual instruction tuning on language model
  ☆44Updated 6 months ago
• kkahatapitiya / LangRepo
  Language Repository for Long Video Understanding
  ☆31Updated 11 months ago
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆74Updated 6 months ago
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆56Updated 6 months ago
• MikeWangWZHL / Paxion
  Repo for paper: "Paxion: Patching Action Knowledge in Video-Language Foundation Models" Neurips 23 Spotlight
  ☆37Updated last year
• Letian2003 / C-VQA
  Counterfactual Reasoning VQA Dataset
  ☆25Updated last year
• mshukor / ima-lmms
  [NeurIPS2024] Official code for (IMA) Implicit Multimodal Alignment: On the Generalization of Frozen LLMs to Multimodal Inputs
  ☆18Updated 7 months ago