vis-nlp / OpenCQA
☆11Updated last year
Related projects: ⓘ
- Dataset introduced in PlotQA: Reasoning over Scientific Plots☆66Updated last year
- ☆96Updated 2 months ago
- SciCap Dataset☆48Updated 2 years ago
- Source code and data used in the papers ViQuAE (Lerner et al., SIGIR'22), Multimodal ICT (Lerner et al., ECIR'23) and Cross-modal Retriev…☆25Updated 8 months ago
- Evaluation code and datasets for the ACL 2024 paper, VISTA: Visualized Text Embedding for Universal Multi-Modal Retrieval. The original c…☆10Updated 2 weeks ago
- [ICLR'24 Spotlight] "Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts"☆51Updated 5 months ago
- ☆58Updated last month
- ☆13Updated 10 months ago
- TAT-DQA: Towards Complex Document Understanding By Discrete Reasoning☆18Updated this week
- The code related to the baselines from NeurIPS 2021 paper "DUE: End-to-End Document Understanding Benchmark."☆36Updated last year
- ☆109Updated last year
- VisualMRC: Machine Reading Comprehension on Document Images (AAAI2021)☆51Updated 3 years ago
- Code and data for the ACL 2024 Findings paper "Do LVLMs Understand Charts? Analyzing and Correcting Factual Errors in Chart Captioning"☆23Updated 3 months ago
- [ICPRAI 2024] DocumentCLIP: Linking Figures and Main Body Text in Reflowed Documents☆16Updated 5 months ago
- ☆42Updated last year
- Visually-Situated Natural Language Understanding with Contrastive Reading Model and Frozen Large Language Models, EMNLP 2023☆43Updated 3 months ago
- ☆26Updated last year
- Code and data for the FACTOR paper☆36Updated 10 months ago
- ☆52Updated 8 months ago
- Research code for "KAT: A Knowledge Augmented Transformer for Vision-and-Language"☆55Updated 2 years ago
- SlideVQA: A Dataset for Document Visual Question Answering on Multiple Images (AAAI2023)☆73Updated 11 months ago
- Code and Data for ManyModalQA: Modality Disambiguation and QA over Diverse Inputs☆17Updated 4 years ago
- [NAACL 2024] MMC: Advancing Multimodal Chart Understanding with LLM Instruction Tuning☆75Updated last month
- EMNLP2023 - InfoSeek: A New VQA Benchmark focus on Visual Info-Seeking Questions☆15Updated 3 months ago
- Pytorch Implementation of Value Retrieval with Arbitrary Queries for Form-like Documents.☆16Updated last year
- NAACL 2022: MCSE: Multimodal Contrastive Learning of Sentence Embeddings☆52Updated 3 months ago
- Code for COLING 2022 long paper: Answering Numerical Reasoning Questions in Table-Text Hybrid Contents with Graph-based Encoder and Tree-…☆21Updated last year
- Official repo for "Imagination-Augmented Natural Language Understanding", NAACL 2022.☆17Updated 2 years ago
- [ACL 2024] This is the code repo for our ACL‘24 paper "MARVEL: Unlocking the Multi-Modal Capability of Dense Retrieval via Visual Module …☆22Updated 2 months ago
- Dataset for TACL 2022 paper: "FeTaQA: Free-form Table Question Answering"☆79Updated last year