Alternatives and similar repositories for VisDoM

Users that are interested in VisDoM are comparing it to the libraries listed below

• mayubo2333 / MMLongBench-Doc
  Official Repository of MMLONGBENCH-DOC: Benchmarking Long-context Document Understanding with Visualizations
  ☆105Updated last month
• open-vision-language / infoseek
  ☆67Updated 2 years ago
• FuxiaoLiu / MMC
  [NAACL 2024] MMC: Advancing Multimodal Chart Understanding with LLM Instruction Tuning
  ☆96Updated 10 months ago
• DataArcTech / RagVL
  Official PyTorch Implementation of MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced …
  ☆87Updated last year
• Go2Heart / EchoSight
  [EMNLP 2024 Findings] The official PyTorch implementation of EchoSight: Advancing Visual-Language Models with Wiki Knowledge.
  ☆77Updated 4 months ago
• TIGER-AI-Lab / UniIR
  Official code for paper "UniIR: Training and Benchmarking Universal Multimodal Information Retrievers" (ECCV 2024)
  ☆167Updated last year
• OpenMatch / MARVEL
  [ACL 2024 Oral] This is the code repo for our ACL‘24 paper "MARVEL: Unlocking the Multi-Modal Capability of Dense Retrieval via Visual Mo…
  ☆39Updated last year
• LightChen233 / M3CoT
  ☆84Updated last year
• dengc2023 / LongDocURL
  ☆32Updated 3 months ago
• chancharikmitra / CCoT
  [CVPR 2024] Official Code for the Paper "Compositional Chain-of-Thought Prompting for Large Multimodal Models"
  ☆141Updated last year
• LinWeizheDragon / Retrieval-Augmented-Visual-Question-Answering
  This is the official repository for Retrieval Augmented Visual Question Answering
  ☆240Updated 10 months ago
• yhy-2000 / VideoDeepResearch
  ☆119Updated 3 weeks ago
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆83Updated last year
• HZQ950419 / Math-LLaVA
  Code for Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models
  ☆91Updated last year
• vis-nlp / UniChart
  ☆82Updated last year
• edchengg / infoseek_eval
  EMNLP2023 - InfoSeek: A New VQA Benchmark focus on Visual Info-Seeking Questions
  ☆25Updated last year
• PaulLerner / ViQuAE
  Source code and data used in the papers ViQuAE (Lerner et al., SIGIR'22), Multimodal ICT (Lerner et al., ECIR'23) and Cross-modal Retriev…
  ☆38Updated 10 months ago
• OpenMatch / UniVL-DR
  [ICLR 2023] This is the code repo for our ICLR‘23 paper "Universal Vision-Language Dense Retrieval: Learning A Unified Representation Spa…
  ☆53Updated last year
• HITsz-TMG / SKURG
  ☆18Updated 2 years ago
• open-vision-language / oven
  ☆40Updated 2 years ago
• bloomberg / m3docrag
  ☆51Updated 5 months ago
• ZUCC-AI / UMIE
  Code and model for AAAI 2024: UMIE: Unified Multimodal Information Extraction with Instruction Tuning
  ☆42Updated last year
• vis-nlp / OpenCQA
  ☆11Updated 2 years ago
• luomancs / ReMuQ
  a multimodal retrieval dataset
  ☆24Updated 2 years ago
• pengts / VW-LMM
  ☆25Updated last year
• Gary-code / KECVQG
  [ACM MM 2023] The released code of paper "Deconfounded Visual Question Generation with Causal Inference"
  ☆10Updated last year
• Wild-Cooperation-Hub / Awesome-MLLM-Reasoning-Benchmarks
  A Comprehensive Survey on Evaluating Reasoning Capabilities in Multimodal Large Language Models.
  ☆69Updated 8 months ago
• InfiMM / Awesome-Multimodal-LLM-for-Math-STEM
  Paper collections of multi-modal LLM for Math/STEM/Code.
  ☆129Updated 3 weeks ago
• princeton-nlp / CharXiv
  [NeurIPS 2024] CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs
  ☆129Updated 6 months ago
• mathllm / MATH-V
  [NeurIPS 2024] MATH-Vision dataset and code to measure multimodal mathematical reasoning capabilities.
  ☆120Updated 6 months ago