ucaslcl / Fox
official code for "Fox: Focus Anywhere for Fine-grained Multi-page Document Understanding"
☆128Updated 5 months ago
Related projects ⓘ
Alternatives and complementary repositories for Fox
- [ACM'MM 2024 Oral] Official code for "OneChart: Purify the Chart Structural Extraction via One Auxiliary Token"☆197Updated last month
- Vary-tiny codebase upon LAVIS (for training from scratch)and a PDF image-text pairs data (about 600k including English/Chinese)☆68Updated 2 months ago
- Document Artifical Intelligence☆130Updated last month
- ☆67Updated this week
- 【ArXiv】PDF-Wukong: A Large Multimodal Model for Efficient Long PDF Reading with End-to-End Sparse Sampling☆98Updated last month
- A High-efficiency Open-source Toolkit for Table-to-Latex Task☆150Updated 2 weeks ago
- ☆126Updated 9 months ago
- ☆201Updated 3 weeks ago
- Dataset and Code for our ACL 2024 paper: "Multimodal Table Understanding". We propose the first large-scale Multimodal IFT and Pre-Train …☆164Updated last month
- ☆55Updated 9 months ago
- ☆156Updated 8 months ago
- A Faster LayoutReader Model based on LayoutLMv3, Sort OCR bboxes to reading order.☆104Updated 5 months ago
- The official code for NeurIPS 2024 paper: Harmonizing Visual Text Comprehension and Generation☆73Updated this week
- Evaluation of the Optical Character Recognition (OCR) capabilities of GPT-4V(ision)☆121Updated last year
- 如需体验textin文档解析,请点击https://cc.co/16YSIy☆58Updated last week
- MPB (Miner-PDF-Benchmark) is an end-to-end PDF document comprehension evaluation suite designed for large-scale model data scenarios.☆15Updated 3 months ago
- 源自PP-Structure的表格识别算法,模型转换为ONNX,推理引擎采用ONNXRuntime,部署简单,无内存泄露问题。☆70Updated last week
- ☆106Updated 9 months ago
- Exploring Efficient Fine-Grained Perception of Multimodal Large Language Models☆51Updated 2 weeks ago
- 360LayoutAnaylsis, a series Document Analysis Models and Datasets deleveped by 360 AI Research Institute☆241Updated 2 months ago
- UniMERNet: A Universal Network for Real-World Mathematical Expression Recognition☆206Updated last month
- Datasets and Evaluation Scripts for CompHRDoc☆25Updated 7 months ago
- pdf 解析☆29Updated 2 weeks ago
- InstructDoc: A Dataset for Zero-Shot Generalization of Visual Document Understanding with Instructions (AAAI2024)☆145Updated 5 months ago
- A Curated List of Awesome Table Structure Recognition (TSR) Research. Including models, papers, datasets and codes. Continuously updating…☆136Updated 2 months ago
- A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision,…☆179Updated 3 weeks ago
- A Simple MLLM Surpassed QwenVL-Max with OpenSource Data Only in 14B LLM.☆36Updated 2 months ago
- [NAACL 2024] Visually Guided Generative Text-Layout Pre-training for Document Intelligence☆49Updated 2 months ago
- On the Hidden Mystery of OCR in Large Multimodal Models (OCRBench)☆473Updated last month
- My implementation of Kosmos2.5 from the paper: "KOSMOS-2.5: A Multimodal Literate Model"☆68Updated last week