Alternatives and similar repositories for VisDoM

Users that are interested in VisDoM are comparing it to the libraries listed below

• FuxiaoLiu / MMC
  [NAACL 2024] MMC: Advancing Multimodal Chart Understanding with LLM Instruction Tuning
  ☆96Updated 9 months ago
• open-vision-language / infoseek
  ☆66Updated 2 years ago
• vis-nlp / OpenCQA
  ☆11Updated 2 years ago
• DataArcTech / RagVL
  Official PyTorch Implementation of MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced …
  ☆86Updated 11 months ago
• Go2Heart / EchoSight
  [EMNLP 2024 Findings] The official PyTorch implementation of EchoSight: Advancing Visual-Language Models with Wiki Knowledge.
  ☆76Updated 4 months ago
• mayubo2333 / MMLongBench-Doc
  Official Repository of MMLONGBENCH-DOC: Benchmarking Long-context Document Understanding with Visualizations
  ☆101Updated last month
• OpenMatch / MARVEL
  [ACL 2024 Oral] This is the code repo for our ACL‘24 paper "MARVEL: Unlocking the Multi-Modal Capability of Dense Retrieval via Visual Mo…
  ☆38Updated last year
• HZQ950419 / Math-LLaVA
  Code for Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models
  ☆91Updated last year
• chancharikmitra / CCoT
  [CVPR 2024] Official Code for the Paper "Compositional Chain-of-Thought Prompting for Large Multimodal Models"
  ☆139Updated last year
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆82Updated 11 months ago
• TIGER-AI-Lab / UniIR
  Official code for paper "UniIR: Training and Benchmarking Universal Multimodal Information Retrievers" (ECCV 2024)
  ☆166Updated last year
• edchengg / infoseek_eval
  EMNLP2023 - InfoSeek: A New VQA Benchmark focus on Visual Info-Seeking Questions
  ☆25Updated last year
• vis-nlp / UniChart
  ☆81Updated last year
• vis-nlp / ChartQA
  ☆221Updated 6 months ago
• bloomberg / m3docrag
  ☆50Updated 5 months ago
• LightChen233 / M3CoT
  ☆84Updated last year
• dengc2023 / LongDocURL
  ☆30Updated 2 months ago
• HITsz-TMG / SKURG
  ☆18Updated last year
• OpenGVLab / ChartAst
  [ACL 2024] ChartAssistant is a chart-based vision-language model for universal chart comprehension and reasoning.
  ☆130Updated last year
• InfiMM / Awesome-Multimodal-LLM-for-Math-STEM
  Paper collections of multi-modal LLM for Math/STEM/Code.
  ☆129Updated this week
• PaulLerner / ViQuAE
  Source code and data used in the papers ViQuAE (Lerner et al., SIGIR'22), Multimodal ICT (Lerner et al., ECIR'23) and Cross-modal Retriev…
  ☆38Updated 10 months ago
• OpenMatch / UniVL-DR
  [ICLR 2023] This is the code repo for our ICLR‘23 paper "Universal Vision-Language Dense Retrieval: Learning A Unified Representation Spa…
  ☆53Updated last year
• khuangaf / Awesome-Chart-Understanding
  A curated list of recent and past chart understanding work based on our IEEE TKDE survey paper: From Pixels to Insights: A Survey on Auto…
  ☆226Updated 4 months ago
• princeton-nlp / CharXiv
  [NeurIPS 2024] CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs
  ☆128Updated 6 months ago
• flowvqa / flowvqa
  The official dataset of the flowvqa project.
  ☆17Updated last year
• yhy-2000 / VideoDeepResearch
  ☆114Updated last week
• Tencent / SelfEvolvingAgent
  Research works from Tencent AI Lab regarding self-evolving agents
  ☆60Updated 2 months ago
• hendryx-scale / mhal-detect
  M-HalDetect Dataset Release
  ☆25Updated last year
• SpursGoZmy / Table-LLaVA
  Dataset and Code for our ACL 2024 paper: "Multimodal Table Understanding". We propose the first large-scale Multimodal IFT and Pre-Train …
  ☆218Updated 4 months ago
• OSU-NLP-Group / LLM-Knowledge-Conflict
  [ICLR'24 Spotlight] "Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts"
  ☆77Updated last year