allenai / pixmo-docs
Synthetic data generation pipelines for Pixmo-docs.
☆18Updated 2 months ago
Alternatives and similar repositories for pixmo-docs:
Users that are interested in pixmo-docs are comparing it to the libraries listed below
- MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answering. A comprehensive evaluation of multimodal large model multilingua…☆52Updated 2 months ago
- A huge dataset for Document Visual Question Answering☆15Updated 6 months ago
- Official Repository of MMLONGBENCH-DOC: Benchmarking Long-context Document Understanding with Visualizations☆67Updated 7 months ago
- The proposed simulated dataset consisting of 9,536 charts and associated data annotations in CSV format.☆21Updated last year
- Exploring Efficient Fine-Grained Perception of Multimodal Large Language Models☆58Updated 3 months ago
- ☆23Updated last year
- [Paper] Code for the EMNLP2023 (Findings) paper "Global Structure Knowledge-Guided Relation Extraction Method for Visually-Rich Document"☆16Updated last year
- [NAACL 2024] MMC: Advancing Multimodal Chart Understanding with LLM Instruction Tuning☆94Updated last month
- ☆23Updated 4 months ago
- Code for ICCV 2023 Paper : “ICL-D3IE: In-Context Learning with Diverse Demonstrations Updating for Document Information Extraction”☆51Updated last year
- ☆129Updated last year
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆40Updated 7 months ago
- Vision-Language Pre-Training for Boosting Scene Text Detectors (CVPR2022)☆12Updated 2 years ago
- WikiTableSet: A largest publicly available image-based table recognition dataset in three languages built from Wikipedia☆27Updated last year
- ☆15Updated 2 years ago
- Touchstone: Evaluating Vision-Language Models by Language Models☆82Updated last year
- A curated list of resources about long-context in large-language models and video understanding.☆30Updated last year
- Evaluation of the Optical Character Recognition (OCR) capabilities of GPT-4V(ision)☆122Updated last year
- Vary-tiny codebase upon LAVIS （for training from scratch）and a PDF image-text pairs data (about 600k including English/Chinese)☆78Updated 5 months ago
- MLLM-DataEngine: An Iterative Refinement Approach for MLLM☆43Updated 8 months ago
- This repo contains code for "VISTA: Enhancing Long-Duration and High-Resolution Video Understanding by VIdeo SpatioTemporal Augmentation"☆11Updated last month
- Code for AAAI 2023 Paper : “Alignment-Enriched Tuning for Patch-Level Pre-trained Document Image Models”☆17Updated 2 years ago
- Implementations of online merging optimizers proposed by Online Merging Optimizers for Boosting Rewards and Mitigating Tax in Alignment☆73Updated 8 months ago
- ☆45Updated 5 months ago
- CTE: Contextualized Table Extraction Dataset☆17Updated last year
- [ICPRAI 2024] DocumentCLIP: Linking Figures and Main Body Text in Reflowed Documents☆16Updated 10 months ago
- [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…☆109Updated 2 months ago
- Empirical Study Towards Building An Effective Multi-Modal Large Language Model☆23Updated last year
- ☆60Updated last year