Alternatives and similar repositories for VisDoM

Users that are interested in VisDoM are comparing it to the libraries listed below

• open-vision-language / infoseek
  ☆59Updated last year
• FuxiaoLiu / MMC
  [NAACL 2024] MMC: Advancing Multimodal Chart Understanding with LLM Instruction Tuning
  ☆98Updated 7 months ago
• mayubo2333 / MMLongBench-Doc
  Official Repository of MMLONGBENCH-DOC: Benchmarking Long-context Document Understanding with Visualizations
  ☆90Updated last year
• OpenMatch / MARVEL
  [ACL 2024] This is the code repo for our ACL‘24 paper "MARVEL: Unlocking the Multi-Modal Capability of Dense Retrieval via Visual Module …
  ☆36Updated last year
• vis-nlp / UniChart
  ☆80Updated 11 months ago
• edchengg / infoseek_eval
  EMNLP2023 - InfoSeek: A New VQA Benchmark focus on Visual Info-Seeking Questions
  ☆25Updated last year
• HITsz-TMG / SKURG
  ☆17Updated last year
• bloomberg / m3docrag
  ☆42Updated 2 months ago
• HZQ950419 / Math-LLaVA
  Code for Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models
  ☆90Updated last year
• khuangaf / Awesome-Chart-Understanding
  A curated list of recent and past chart understanding work based on our IEEE TKDE survey paper: From Pixels to Insights: A Survey on Auto…
  ☆215Updated last month
• DataArcTech / RagVL
  Official PyTorch Implementation of MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced …
  ☆79Updated 9 months ago
• LightChen233 / M3CoT
  ☆78Updated last year
• vis-nlp / ChartQA
  ☆215Updated 3 months ago
• Go2Heart / EchoSight
  [EMNLP 2024 Findings] The official PyTorch implementation of EchoSight: Advancing Visual-Language Models with Wiki Knowledge.
  ☆73Updated last month
• PaulLerner / ViQuAE
  Source code and data used in the papers ViQuAE (Lerner et al., SIGIR'22), Multimodal ICT (Lerner et al., ECIR'23) and Cross-modal Retriev…
  ☆38Updated 7 months ago
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆80Updated 9 months ago
• OpenGVLab / ChartAst
  [ACL 2024] ChartAssistant is a chart-based vision-language model for universal chart comprehension and reasoning.
  ☆123Updated 11 months ago
• TIGER-AI-Lab / UniIR
  Official code for paper "UniIR: Training and Benchmarking Universal Multimodal Information Retrievers" (ECCV 2024)
  ☆158Updated 10 months ago
• chancharikmitra / CCoT
  [CVPR 2024] Official Code for the Paper "Compositional Chain-of-Thought Prompting for Large Multimodal Models"
  ☆134Updated last year
• vis-nlp / OpenCQA
  ☆11Updated 2 years ago
• yhy-2000 / VideoDeepResearch
  ☆91Updated last month
• InfiMM / Awesome-Multimodal-LLM-for-Math-STEM
  Paper collections of multi-modal LLM for Math/STEM/Code.
  ☆118Updated 3 weeks ago
• vis-nlp / Chart-to-text
  ☆115Updated last year
• LinWeizheDragon / Retrieval-Augmented-Visual-Question-Answering
  This is the official repository for Retrieval Augmented Visual Question Answering
  ☆231Updated 7 months ago
• harrytea / Awesome-Document-Understanding
  Document Artifical Intelligence
  ☆184Updated 3 months ago
• Liac-li / MM-self-improve-qwen2vl
  ☆13Updated 8 months ago
• flowvqa / flowvqa
  The official dataset of the flowvqa project.
  ☆16Updated last year
• NiuTrans / Vision-LLM-Alignment
  This repository contains the code for SFT, RLHF, and DPO, designed for vision-based LLMs, including the LLaVA models and the LLaMA-3.2-vi…
  ☆111Updated last month
• pranonrahman / ChartSumm
  ChartSum is a large scale benchmark for automatic chart to text summarization
  ☆11Updated 2 years ago
• Vision-CAIR / dochaystacks
  Document Haystacks: Vision-Language Reasoning Over Piles of 1000+ Documents, CVPR 2025
  ☆21Updated 6 months ago