yuyq96 / TextHawk
Exploring Efficient Fine-Grained Perception of Multimodal Large Language Models
☆45Updated 4 months ago
Related projects: ⓘ
- ☆54Updated 3 weeks ago
- The official repo for “TextCoT: Zoom In for Enhanced Multimodal Text-Rich Image Understanding”.☆25Updated 2 months ago
- ☆53Updated 7 months ago
- This is the official implementation of the paper "Needle In A Multimodal Haystack"☆72Updated 2 months ago
- ☆70Updated 6 months ago
- ☆146Updated 6 months ago
- The huggingface implementation of Fine-grained Late-interaction Multi-modal Retriever.☆64Updated 2 weeks ago
- Official Repository of MMLONGBENCH-DOC: Benchmarking Long-context Document Understanding with Visualizations☆47Updated 2 months ago
- Research Code for Multimodal-Cognition Team in Ant Group☆111Updated 2 months ago
- official code for "Fox: Focus Anywhere for Fine-grained Multi-page Document Understanding"☆102Updated 3 months ago
- Evaluation of the Optical Character Recognition (OCR) capabilities of GPT-4V(ision)☆116Updated 10 months ago
- A Simple MLLM Surpassed QwenVL-Max with OpenSource Data Only in 14B LLM.☆35Updated last week
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆36Updated 2 months ago
- The official code of "RWKV-CLIP: A Robust Vision-Language Representation Learner"☆97Updated 2 months ago
- ☆29Updated 3 months ago
- [MM2024, oral] "Self-Supervised Visual Preference Alignment" https://arxiv.org/abs/2404.10501☆32Updated last month
- ☆110Updated 7 months ago
- [NAACL 2024] Visually Guided Generative Text-Layout Pre-training for Document Intelligence☆41Updated last week
- Vary-tiny codebase upon LAVIS (for training from scratch)and a PDF image-text pairs data (about 600k including English/Chinese)☆43Updated 4 months ago
- Document Artifical Intelligence☆113Updated last week
- The proposed simulated dataset consisting of 9,536 charts and associated data annotations in CSV format.☆20Updated 6 months ago
- Datasets and Evaluation Scripts for CompHRDoc☆19Updated 5 months ago
- Touchstone: Evaluating Vision-Language Models by Language Models☆75Updated 8 months ago
- Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "☆49Updated last month
- [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback☆218Updated last week
- ☆34Updated 3 months ago
- ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models☆128Updated last month
- The official code for “DeepEraser: Deep Iterative Context Mining for Generic Text Eraser”, TMM, 2024.☆27Updated 3 weeks ago
- LVBench: An Extreme Long Video Understanding Benchmark☆51Updated 2 weeks ago
- Video dataset dedicated to portrait-mode video recognition.☆35Updated 5 months ago