tingyaohsu / SciCap

Related projects ⓘ

Alternatives and complementary repositories for SciCap

• nttmdlab-nlp / VisualMRC
  VisualMRC: Machine Reading Comprehension on Document Images (AAAI2021)
  ☆51Updated 3 years ago
• vis-nlp / Chart-to-text
  ☆106Updated 4 months ago
• NiteshMethani / PlotQA
  Dataset introduced in PlotQA: Reasoning over Scientific Plots
  ☆70Updated last year
• due-benchmark / baselines
  The code related to the baselines from NeurIPS 2021 paper "DUE: End-to-End Document Understanding Benchmark."
  ☆35Updated last year
• vis-nlp / UniChart
  ☆64Updated 3 months ago
• khuangaf / CHOCOLATE
  Code and data for the ACL 2024 Findings paper "Do LVLMs Understand Charts? Analyzing and Correcting Factual Errors in Chart Captioning"
  ☆23Updated 5 months ago
• nttmdlab-nlp / SlideVQA
  SlideVQA: A Dataset for Document Visual Question Answering on Multiple Images (AAAI2023)
  ☆78Updated last year
• allenai / multimodalqa
  ☆113Updated 2 years ago
• vis-nlp / OpenCQA
  ☆11Updated last year
• vis-nlp / ChartQA
  ☆170Updated 4 months ago
• open-vision-language / oven
  ☆28Updated last year
• VT-NLP / MultiInstruct
  MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
  ☆133Updated last year
• PaulLerner / ViQuAE
  Source code and data used in the papers ViQuAE (Lerner et al., SIGIR'22), Multimodal ICT (Lerner et al., ECIR'23) and Cross-modal Retriev…
  ☆27Updated 10 months ago
• guilk / KAT
  Research code for "KAT: A Knowledge Augmented Transformer for Vision-and-Language"
  ☆61Updated 2 years ago
• thu-coai / PICL
  Code for ACL2023 paper: Pre-Training to Learn in Context
  ☆107Updated 3 months ago
• rubenpt91 / MP-DocVQA-Framework
  ☆54Updated 10 months ago
• TIGER-AI-Lab / UniIR
  Official code for paper "UniIR: Training and Benchmarking Universal Multimodal Information Retrievers" (ECCV 2024)
  ☆110Updated last month
• WebQnA / WebQA
  ☆46Updated last month
• mayubo2333 / MMLongBench-Doc
  Official Repository of MMLONGBENCH-DOC: Benchmarking Long-context Document Understanding with Visualizations
  ☆57Updated 4 months ago
• shizhediao / DaVinci
  Source code for the paper "Prefix Language Models are Unified Modal Learners"
  ☆43Updated last year
• FuxiaoLiu / MMC
  [NAACL 2024] MMC: Advancing Multimodal Chart Understanding with LLM Instruction Tuning
  ☆84Updated 2 months ago
• facebookresearch / UniK-QA
  Unified Representations of Structured and Unstructured Knowledge for Open-Domain Question Answering
  ☆49Updated 2 years ago
• WadeYin9712 / GD-VCR
  Code and data for "Broaden the Vision: Geo-Diverse Visual Commonsense Reasoning" (EMNLP 2021).
  ☆28Updated 3 years ago
• salesforce / QVR-SimpleDLM
  Pytorch Implementation of Value Retrieval with Arbitrary Queries for Form-like Documents.
  ☆16Updated last year
• NExTplusplus / TAT-DQA
  TAT-DQA: Towards Complex Document Understanding By Discrete Reasoning
  ☆19Updated 2 months ago
• woojeongjin / FewVLM
  A Good Prompt Is Worth Millions of Parameters: Low-resource Prompt-based Learning for Vision-Language Models (ACL 2022)
  ☆40Updated 2 years ago
• uds-lsv / MCSE
  NAACL 2022: MCSE: Multimodal Contrastive Learning of Sentence Embeddings
  ☆53Updated 5 months ago
• e-bug / cross-modal-ablation
  [EMNLP 2021] Code and data for our paper "Vision-and-Language or Vision-for-Language? On Cross-Modal Influence in Multimodal Transformers…
  ☆20Updated 2 years ago
• JasonObeid / Chart2Text
  Chart-to-Text: Generating Natural Language Explanations for Charts by Adapting the Transformer Model
  ☆149Updated last year
• uakarsh / latr
  Implementation of LaTr: Layout-aware transformer for scene-text VQA,a novel multimodal architecture for Scene Text Visual Question Answer…
  ☆52Updated 3 weeks ago