Yuliang-Liu / MultimodalOCRLinks
On the Hidden Mystery of OCR in Large Multimodal Models (OCRBench)
☆717Updated 2 months ago
Alternatives and similar repositories for MultimodalOCR
Users that are interested in MultimodalOCR are comparing it to the libraries listed below
Sorting:
- Document Artifical Intelligence☆190Updated this week
- ☆140Updated last year
- Dataset and Code for our ACL 2024 paper: "Multimodal Table Understanding". We propose the first large-scale Multimodal IFT and Pre-Train …☆216Updated 3 months ago
- [ACM'MM 2024 Oral] Official code for "OneChart: Purify the Chart Structural Extraction via One Auxiliary Token"☆229Updated 5 months ago
- official code for "Fox: Focus Anywhere for Fine-grained Multi-page Document Understanding"☆154Updated last year
- ☆183Updated last year
- ☆371Updated 7 months ago
- Vary-tiny codebase upon LAVIS (for training from scratch)and a PDF image-text pairs data (about 600k including English/Chinese)☆86Updated last year
- ☆153Updated 4 months ago
- A High-efficiency Open-source Toolkit for Table-to-Latex Task☆263Updated 9 months ago
- ☆249Updated last year
- Evaluation of the Optical Character Recognition (OCR) capabilities of GPT-4V(ision)☆125Updated last year
- 【ArXiv】PDF-Wukong: A Large Multimodal Model for Efficient Long PDF Reading with End-to-End Sparse Sampling☆125Updated 3 months ago
- Algorithms, papers, datasets, performance comparisons for Document AI. Continuously updating.☆200Updated 7 months ago
- ☆41Updated 7 months ago
- A Curated List of Awesome Table Structure Recognition (TSR) Research. Including models, papers, datasets and codes. Continuously updating…☆211Updated last year
- ☆99Updated 9 months ago
- A collection of OCR-related datasets☆189Updated 3 years ago
- [CVPR'25 highlight] RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthiness☆414Updated 4 months ago
- A Framework of Small-scale Large Multimodal Models☆901Updated 5 months ago
- ☆38Updated last year
- [NAACL 2024] Visually Guided Generative Text-Layout Pre-training for Document Intelligence☆146Updated last year
- LLaVA-UHD v2: an MLLM Integrating High-Resolution Semantic Pyramid via Hierarchical Window Transformer☆387Updated 5 months ago
- [ICLR 2025 Spotlight] OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text☆395Updated 4 months ago
- PDF解析工具:GOT的vLLM加速实现,MinerU做布局识别裁剪、GOT做表格公式解析,实现RAG中的pdf解析☆62Updated 10 months ago
- A Faster LayoutReader Model based on LayoutLMv3, Sort OCR bboxes to reading order.☆280Updated last month
- An implementation of "CLIP4STR: A Simple Baseline for Scene Text Recognition with Pre-trained Vision-Language Model".☆144Updated 6 months ago
- Code/Data for the paper: "LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding"☆269Updated last year
- A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision,…☆335Updated 7 months ago
- UniTable: Towards a Unified Table Foundation Model☆506Updated last year