Alternatives and similar repositories for multimodal_textbook:

Users that are interested in multimodal_textbook are comparing it to the libraries listed below

• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆96Updated 3 weeks ago
• OpenGVLab / MM-NIAH
  [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…
  ☆113Updated 3 months ago
• dongyh20 / Insight-V
  [CVPR2025] Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models
  ☆155Updated this week
• HZQ950419 / Math-LLaVA
  Code for Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models
  ☆78Updated 8 months ago
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆130Updated 4 months ago
• Liuziyu77 / MMDU
  Official repository of MMDU dataset
  ☆86Updated 5 months ago
• FudanNLPLAB / MouSi
  ☆73Updated last year
• zwq2018 / Multi-modal-Self-instruct
  The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…
  ☆72Updated last month
• InfiMM / Awesome-Multimodal-LLM-for-Math-STEM
  Paper collections of multi-modal LLM for Math/STEM/Code.
  ☆81Updated this week
• mathllm / MATH-V
  [NeurIPS DB Track, 2024] MATH-Vision dataset and code to measure multimodal mathematical reasoning capabilities.
  ☆93Updated last week
• TideDra / VL-RLHF
  A RLHF Infrastructure for Vision-Language Models
  ☆167Updated 4 months ago
• TIGER-AI-Lab / Mantis
  Official code for Paper "Mantis: Multi-Image Instruction Tuning" [TMLR2024]
  ☆208Updated this week
• njucckevin / MM-Self-Improve
  A Self-Training Framework for Vision-Language Reasoning
  ☆70Updated last month
• MMStar-Benchmark / MMStar
  [NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"
  ☆168Updated 5 months ago
• RifleZhang / LLaVA-Reasoner-DPO
  ☆66Updated 2 months ago
• princeton-nlp / CharXiv
  [NeurIPS 2024] CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs
  ☆99Updated 2 months ago
• RLHF-V / RLHF-V
  [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback
  ☆266Updated 6 months ago
• FreedomIntelligence / LongLLaVA
  LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
  ☆199Updated 2 months ago
• FreedomIntelligence / ALLaVA
  Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model
  ☆257Updated 8 months ago
• THUDM / LVBench
  LVBench: An Extreme Long Video Understanding Benchmark
  ☆85Updated 6 months ago
• yfzhang114 / SliME
  ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models
  ☆154Updated 2 months ago
• OpenGVLab / MMT-Bench
  ICML'2024 | MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI
  ☆104Updated 8 months ago
• hewei2001 / ReachQA
  Code & Dataset for Paper: "Distill Visual Chart Reasoning Ability from LLMs to MLLMs"
  ☆50Updated 4 months ago
• Liuziyu77 / MIA-DPO
  Official implement of MIA-DPO
  ☆54Updated last month
• bronyayang / Law_of_Vision_Representation_in_MLLMs
  Official implementation of the Law of Vision Representation in MLLMs
  ☆151Updated 4 months ago
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆368Updated this week
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆65Updated 9 months ago
• OFA-Sys / TouchStone
  Touchstone: Evaluating Vision-Language Models by Language Models
  ☆82Updated last year