Alternatives and similar repositories for VisDoM

Users that are interested in VisDoM are comparing it to the libraries listed below

• mayubo2333 / MMLongBench-Doc
  Official Repository of MMLONGBENCH-DOC: Benchmarking Long-context Document Understanding with Visualizations
  ☆108Updated 2 months ago
• DataArcTech / RagVL
  Official PyTorch Implementation of MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced …
  ☆89Updated last year
• FuxiaoLiu / MMC
  [NAACL 2024] MMC: Advancing Multimodal Chart Understanding with LLM Instruction Tuning
  ☆96Updated 11 months ago
• OpenMatch / MARVEL
  [ACL 2024 Oral] This is the code repo for our ACL‘24 paper "MARVEL: Unlocking the Multi-Modal Capability of Dense Retrieval via Visual Mo…
  ☆39Updated last year
• HZQ950419 / Math-LLaVA
  Code for Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models
  ☆92Updated last year
• chancharikmitra / CCoT
  [CVPR 2024] Official Code for the Paper "Compositional Chain-of-Thought Prompting for Large Multimodal Models"
  ☆142Updated last year
• LightChen233 / M3CoT
  ☆84Updated last year
• OpenGVLab / ChartAst
  [ACL 2024] ChartAssistant is a chart-based vision-language model for universal chart comprehension and reasoning.
  ☆131Updated last year
• LinWeizheDragon / Retrieval-Augmented-Visual-Question-Answering
  This is the official repository for Retrieval Augmented Visual Question Answering
  ☆242Updated 11 months ago
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆83Updated last year
• dengc2023 / LongDocURL
  ☆35Updated 4 months ago
• SpursGoZmy / Table-LLaVA
  Dataset and Code for our ACL 2024 paper: "Multimodal Table Understanding". We propose the first large-scale Multimodal IFT and Pre-Train …
  ☆220Updated 5 months ago
• TIGER-AI-Lab / UniIR
  Official code for paper "UniIR: Training and Benchmarking Universal Multimodal Information Retrievers" (ECCV 2024)
  ☆169Updated last year
• bloomberg / m3docrag
  ☆54Updated 6 months ago
• vis-nlp / UniChart
  ☆82Updated last year
• Omaralsaabi / M3DOCRAG
  An implementation of "M3DOCRAG: Multi-modal Retrieval is What You Need for Multi-page Multi-document Understanding" by Jaemin Cho, Debanj…
  ☆47Updated last year
• yhy-2000 / VideoDeepResearch
  ☆123Updated 3 weeks ago
• princeton-nlp / CharXiv
  [NeurIPS 2024] CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs
  ☆134Updated 7 months ago
• mathllm / MATH-V
  [NeurIPS 2024] MATH-Vision dataset and code to measure multimodal mathematical reasoning capabilities.
  ☆126Updated 6 months ago
• Kun-Xiang / AtomThink
  Offical Repository of "AtomThink: Multimodal Slow Thinking with Atomic Step Reasoning"
  ☆57Updated 2 weeks ago
• khuangaf / Awesome-Chart-Understanding
  A curated list of recent and past chart understanding work based on our IEEE TKDE survey paper: From Pixels to Insights: A Survey on Auto…
  ☆228Updated 5 months ago
• Go2Heart / EchoSight
  [EMNLP 2024 Findings] The official PyTorch implementation of EchoSight: Advancing Visual-Language Models with Wiki Knowledge.
  ☆77Updated 5 months ago
• njucckevin / MM-Self-Improve
  A Self-Training Framework for Vision-Language Reasoning
  ☆87Updated 10 months ago
• open-vision-language / infoseek
  ☆67Updated 2 years ago
• HITsz-TMG / SKURG
  ☆18Updated 2 years ago
• jinbo0906 / Awesome-MLLM-Datasets
  This project aims to collect and collate various datasets for multimodal large model training, including but not limited to pre-training …
  ☆59Updated 7 months ago
• swordlidev / Evaluation-Multimodal-LLMs-Survey
  A Survey on Benchmarks of Multimodal Large Language Models
  ☆145Updated 5 months ago
• InfiMM / Awesome-Multimodal-LLM-for-Math-STEM
  Paper collections of multi-modal LLM for Math/STEM/Code.
  ☆130Updated 3 weeks ago
• vis-nlp / ChartQA
  ☆230Updated 7 months ago
• harrytea / Awesome-Document-Understanding
  Document Artifical Intelligence
  ☆194Updated 2 months ago