Alternatives and similar repositories for multimodal_textbook:

Users that are interested in multimodal_textbook are comparing it to the libraries listed below

• LengSicong / MMR1
  MMR1: Advancing the Frontiers of Multimodal Reasoning
  ☆151Updated 3 weeks ago
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆99Updated last month
• OpenGVLab / MM-NIAH
  [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…
  ☆114Updated 4 months ago
• zwq2018 / Multi-modal-Self-instruct
  The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…
  ☆74Updated 2 months ago
• TIGER-AI-Lab / Mantis
  Official code for Paper "Mantis: Multi-Image Instruction Tuning" [TMLR2024]
  ☆210Updated 2 weeks ago
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆131Updated 4 months ago
• Liuziyu77 / MMDU
  Official repository of MMDU dataset
  ☆87Updated 6 months ago
• dongyh20 / Insight-V
  [CVPR2025 Highlight] Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models
  ☆179Updated last week
• TideDra / VL-RLHF
  A RLHF Infrastructure for Vision-Language Models
  ☆170Updated 4 months ago
• princeton-nlp / CharXiv
  [NeurIPS 2024] CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs
  ☆103Updated 3 months ago
• RifleZhang / LLaVA-Reasoner-DPO
  ☆71Updated 3 months ago
• OpenRLHF / OpenRLHF-M
  An Easy-to-use, Scalable and High-performance RLHF Framework designed for Multimodal Models.
  ☆107Updated this week
• RLHF-V / RLHF-V
  [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback
  ☆275Updated 7 months ago
• FreedomIntelligence / ALLaVA
  Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model
  ☆260Updated 9 months ago
• hewei2001 / ReachQA
  Code & Dataset for Paper: "Distill Visual Chart Reasoning Ability from LLMs to MLLMs"
  ☆52Updated 5 months ago
• GAIR-NLP / MAYE
  Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme
  ☆54Updated this week
• HZQ950419 / Math-LLaVA
  Code for Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models
  ☆83Updated 9 months ago
• OpenGVLab / MMT-Bench
  ICML'2024 | MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI
  ☆106Updated 8 months ago
• FudanNLPLAB / MouSi
  ☆73Updated last year
• mathllm / MATH-V
  [NeurIPS 2024] MATH-Vision dataset and code to measure multimodal mathematical reasoning capabilities.
  ☆102Updated this week
• thunlp / Muffin
  ☆62Updated last year
• InfiMM / Awesome-Multimodal-LLM-for-Math-STEM
  Paper collections of multi-modal LLM for Math/STEM/Code.
  ☆85Updated 2 weeks ago
• SparksJoe / Prism
  A Framework for Decoupling and Assessing the Capabilities of VLMs
  ☆41Updated 9 months ago
• njucckevin / MM-Self-Improve
  A Self-Training Framework for Vision-Language Reasoning
  ☆73Updated 2 months ago
• MMStar-Benchmark / MMStar
  [NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"
  ☆174Updated 6 months ago
• FreedomIntelligence / LongLLaVA
  LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
  ☆201Updated 3 months ago
• IDEA-FinAI / RagVL
  Official PyTorch Implementation of MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced …
  ☆66Updated 4 months ago
• RifleZhang / LLaVA-Hound-DPO
  ☆144Updated 5 months ago
• open-compass / MMBench
  Official Repo of "MMBench: Is Your Multi-modal Model an All-around Player?"
  ☆198Updated 7 months ago
• Kwai-YuanQi / MM-RLHF
  The Next Step Forward in Multimodal LLM Alignment
  ☆142Updated last month