Yuliang-Liu / MultimodalOCRLinks
On the Hidden Mystery of OCR in Large Multimodal Models (OCRBench)
☆701Updated 2 months ago
Alternatives and similar repositories for MultimodalOCR
Users that are interested in MultimodalOCR are comparing it to the libraries listed below
Sorting:
- Document Artifical Intelligence☆189Updated 4 months ago
- Dataset and Code for our ACL 2024 paper: "Multimodal Table Understanding". We propose the first large-scale Multimodal IFT and Pre-Train …☆214Updated 3 months ago
- ☆137Updated last year
- [ACM'MM 2024 Oral] Official code for "OneChart: Purify the Chart Structural Extraction via One Auxiliary Token"☆228Updated 4 months ago
- official code for "Fox: Focus Anywhere for Fine-grained Multi-page Document Understanding"☆154Updated last year
- 【ArXiv】PDF-Wukong: A Large Multimodal Model for Efficient Long PDF Reading with End-to-End Sparse Sampling☆123Updated 3 months ago
- ☆368Updated 7 months ago
- ☆183Updated last year
- Vary-tiny codebase upon LAVIS (for training from scratch)and a PDF image-text pairs data (about 600k including English/Chinese)☆86Updated 11 months ago
- A High-efficiency Open-source Toolkit for Table-to-Latex Task☆263Updated 9 months ago
- ☆148Updated 4 months ago
- A Curated List of Awesome Table Structure Recognition (TSR) Research. Including models, papers, datasets and codes. Continuously updating…☆210Updated last year
- [ICLR 2025 Spotlight] OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text☆391Updated 4 months ago
- ☆98Updated 8 months ago
- Algorithms, papers, datasets, performance comparisons for Document AI. Continuously updating.☆200Updated 6 months ago
- Evaluation of the Optical Character Recognition (OCR) capabilities of GPT-4V(ision)☆125Updated last year
- LLaVA-UHD v2: an MLLM Integrating High-Resolution Semantic Pyramid via Hierarchical Window Transformer☆383Updated 4 months ago
- A Framework of Small-scale Large Multimodal Models☆893Updated 4 months ago
- [CVPR'25 highlight] RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthiness☆410Updated 3 months ago
- PDF解析工具:GOT的vLLM加速实现,MinerU做布局识别裁剪、GOT做表格公式解析,实现RAG中的pdf解析☆61Updated 10 months ago
- A collection of OCR-related datasets☆188Updated 3 years ago
- Code/Data for the paper: "LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding"☆269Updated last year
- ☆795Updated last year
- ☆38Updated 7 months ago
- An unofficial Pytorch implementation of ERNIE-Layout which is originally released through PaddleNLP.☆106Updated last year
- ☆217Updated 4 months ago
- A family of lightweight multimodal models.☆1,039Updated 9 months ago
- ☆248Updated last year
- This repository is the codebase of TabPedia: Towards Comprehensive Visual Table Understanding with Concept Synergy☆45Updated 10 months ago
- A curated list of recent and past chart understanding work based on our IEEE TKDE survey paper: From Pixels to Insights: A Survey on Auto…☆218Updated 2 months ago