Alternatives and similar repositories for multimodal_textbook:

Users that are interested in multimodal_textbook are comparing it to the libraries listed below

• zwq2018 / Multi-modal-Self-instruct
  The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…
  ☆67Updated last month
• OpenGVLab / MM-NIAH
  [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…
  ☆108Updated last month
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆127Updated last month
• Liuziyu77 / MIA-DPO
  Official implement of MIA-DPO
  ☆48Updated 2 months ago
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆41Updated this week
• dongyh20 / Insight-V
  Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models
  ☆126Updated 3 weeks ago
• mathllm / MATH-V
  MATH-Vision dataset and code to measure Multimodal Mathematical Reasoning capabilities.
  ☆77Updated 3 months ago
• Liuziyu77 / MMDU
  Official repository of MMDU dataset
  ☆79Updated 3 months ago
• swordlidev / Evaluation-Multimodal-LLMs-Survey
  A Survey on Benchmarks of Multimodal Large Language Models
  ☆76Updated last week
• THUDM / LVBench
  LVBench: An Extreme Long Video Understanding Benchmark
  ☆70Updated 4 months ago
• RifleZhang / LLaVA-Reasoner-DPO
  ☆47Updated this week
• mlfoundations / VisIT-Bench
  ☆47Updated last year
• HZQ950419 / Math-LLaVA
  Code for Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models
  ☆75Updated 6 months ago
• orrzohar / Video-STaR
  Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆58Updated 6 months ago
• hewei2001 / ReachQA
  Code & Dataset for Paper: "Distill Visual Chart Reasoning Ability from LLMs to MLLMs"
  ☆44Updated 2 months ago
• FudanNLPLAB / MouSi
  ☆74Updated 10 months ago
• IDEA-FinAI / RagVL
  Official PyTorch Implementation of MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced …
  ☆47Updated last month
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆62Updated 7 months ago
• ParadoxZW / LLaVA-UHD-Better
  A bug-free and improved implementation of LLaVA-UHD, based on the code from the official repo
  ☆32Updated 4 months ago
• vlf-silkie / VLFeedback
  ☆92Updated last year
• yfzhang114 / SliME
  ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models
  ☆146Updated 2 weeks ago
• SparksJoe / Prism
  A Framework for Decoupling and Assessing the Capabilities of VLMs
  ☆40Updated 6 months ago
• princeton-nlp / CharXiv
  [NeurIPS 2024] CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs
  ☆93Updated 2 weeks ago
• RupertLuo / VoCoT
  VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models
  ☆38Updated 5 months ago
• foundation-multimodal-models / CAPTURE
  ☆42Updated 5 months ago
• thunlp / Muffin
  ☆59Updated 11 months ago
• jihaonew / MM-Instruct
  MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment
  ☆31Updated 6 months ago
• OpenGVLab / MMT-Bench
  ICML'2024 | MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI
  ☆96Updated 5 months ago
• MBZUAI-LLM / web2code
  Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs
  ☆70Updated 2 months ago
• MileBench / MileBench
  This repo contains evaluation code for the paper "MileBench: Benchmarking MLLMs in Long Context"
  ☆28Updated 5 months ago