Alternatives and similar repositories for multimodal_textbook:

Users that are interested in multimodal_textbook are comparing it to the libraries listed below

• LengSicong / MMR1
  MMR1: Advancing the Frontiers of Multimodal Reasoning
  ☆159Updated last month
• EvolvingLMMs-Lab / multimodal-search-r1
  ☆91Updated 3 weeks ago
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆100Updated 2 months ago
• zwq2018 / Multi-modal-Self-instruct
  The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…
  ☆78Updated 3 months ago
• OpenGVLab / MM-NIAH
  [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…
  ☆116Updated 5 months ago
• princeton-nlp / CharXiv
  [NeurIPS 2024] CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs
  ☆110Updated last week
• HZQ950419 / Math-LLaVA
  Code for Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models
  ☆84Updated 10 months ago
• OpenRLHF / OpenRLHF-M
  An Easy-to-use, Scalable and High-performance RLHF Framework designed for Multimodal Models.
  ☆120Updated 3 weeks ago
• mathllm / MATH-V
  [NeurIPS 2024] MATH-Vision dataset and code to measure multimodal mathematical reasoning capabilities.
  ☆103Updated last week
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆133Updated 5 months ago
• dongyh20 / Insight-V
  [CVPR2025 Highlight] Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models
  ☆188Updated last month
• njucckevin / MM-Self-Improve
  A Self-Training Framework for Vision-Language Reasoning
  ☆77Updated 3 months ago
• MMStar-Benchmark / MMStar
  [NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"
  ☆175Updated 7 months ago
• FudanNLPLAB / MouSi
  ☆73Updated last year
• InfiMM / Awesome-Multimodal-LLM-for-Math-STEM
  Paper collections of multi-modal LLM for Math/STEM/Code.
  ☆88Updated 2 weeks ago
• RifleZhang / LLaVA-Reasoner-DPO
  ☆74Updated 3 months ago
• GAIR-NLP / MAYE
  Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme
  ☆120Updated 3 weeks ago
• Liuziyu77 / MMDU
  Official repository of MMDU dataset
  ☆89Updated 7 months ago
• John-AI-Lab / NoisyRollout
  NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation
  ☆53Updated last week
• TideDra / VL-RLHF
  A RLHF Infrastructure for Vision-Language Models
  ☆173Updated 5 months ago
• UCSC-VLAA / VLAA-Thinking
  SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models
  ☆99Updated last week
• THUDM / LVBench
  LVBench: An Extreme Long Video Understanding Benchmark
  ☆89Updated 8 months ago
• hewei2001 / ReachQA
  Code & Dataset for Paper: "Distill Visual Chart Reasoning Ability from LLMs to MLLMs"
  ☆53Updated 6 months ago
• InternLM / OREAL
  Exploring the Limit of Outcome Reward for Learning Mathematical Reasoning
  ☆175Updated last month
• RLHF-V / RLHF-V
  [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback
  ☆276Updated 7 months ago
• TIGER-AI-Lab / Mantis
  Official code for Paper "Mantis: Multi-Image Instruction Tuning" [TMLR2024]
  ☆214Updated last month
• lzhxmu / CPPO
  CPPO: Accelerating the Training of Group Relative Policy Optimization-Based Reasoning Models
  ☆121Updated last week
• thunlp / Muffin
  ☆63Updated last year
• TIGER-AI-Lab / VL-Rethinker
  The official code of "VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning"
  ☆78Updated last week
• MME-Benchmarks / MME-CoT
  MME-CoT: Benchmarking Chain-of-Thought in LMMs for Reasoning Quality, Robustness, and Efficiency
  ☆104Updated this week