Yuliang-Liu / MultimodalOCR
On the Hidden Mystery of OCR in Large Multimodal Models (OCRBench)
☆571Updated last month
Alternatives and similar repositories for MultimodalOCR:
Users that are interested in MultimodalOCR are comparing it to the libraries listed below
- Document Artifical Intelligence☆155Updated 3 months ago
- ☆171Updated last year
- ☆131Updated last year
- official code for "Fox: Focus Anywhere for Fine-grained Multi-page Document Understanding"☆141Updated 9 months ago
- [ACM'MM 2024 Oral] Official code for "OneChart: Purify the Chart Structural Extraction via One Auxiliary Token"☆219Updated last month
- A High-efficiency Open-source Toolkit for Table-to-Latex Task☆221Updated 3 months ago
- ☆339Updated last month
- Vary-tiny codebase upon LAVIS (for training from scratch)and a PDF image-text pairs data (about 600k including English/Chinese)☆79Updated 6 months ago
- Dataset and Code for our ACL 2024 paper: "Multimodal Table Understanding". We propose the first large-scale Multimodal IFT and Pre-Train …☆189Updated 5 months ago
- A Comprehensive Benchmark for Document Parsing and Evaluation☆288Updated 3 weeks ago
- LLaVA-UHD v2: an MLLM Integrating High-Resolution Semantic Pyramid via Hierarchical Window Transformer☆369Updated this week
- An open-source implementaion for fine-tuning Qwen2-VL and Qwen2.5-VL series by Alibaba Cloud.☆492Updated this week
- Code/Data for the paper: "LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding"☆265Updated 9 months ago
- A Framework of Small-scale Large Multimodal Models☆775Updated last month
- 【ArXiv】PDF-Wukong: A Large Multimodal Model for Efficient Long PDF Reading with End-to-End Sparse Sampling☆115Updated 5 months ago
- Evaluation of the Optical Character Recognition (OCR) capabilities of GPT-4V(ision)☆122Updated last year
- [CVPR'25] RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthiness☆319Updated 2 weeks ago
- [ICLR 2025 Spotlight] OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text☆326Updated 4 months ago
- ☆772Updated 8 months ago
- Algorithms, papers, datasets, performance comparisons for Document AI. Continuously updating.☆183Updated 3 weeks ago
- [NAACL 2024] Visually Guided Generative Text-Layout Pre-training for Document Intelligence☆141Updated 6 months ago
- ☆223Updated last year
- Official Repo of "MMBench: Is Your Multi-modal Model an All-around Player?"☆193Updated 6 months ago
- Aligning LMMs with Factually Augmented RLHF☆358Updated last year
- ☆81Updated 3 months ago
- ☆118Updated last year
- A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision,…☆278Updated 3 weeks ago
- A Curated List of Awesome Table Structure Recognition (TSR) Research. Including models, papers, datasets and codes. Continuously updating…☆165Updated 6 months ago
- My implementation of Kosmos2.5 from the paper: "KOSMOS-2.5: A Multimodal Literate Model"☆73Updated last month
- MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)☆290Updated 2 months ago