harrytea / TGDoc
arXiv 23 "Towards Improving Document Understanding: An Exploration on Text-Grounding via MLLMs"
☆14Updated 3 months ago
Alternatives and similar repositories for TGDoc:
Users that are interested in TGDoc are comparing it to the libraries listed below
- The official repo for “TextCoT: Zoom In for Enhanced Multimodal Text-Rich Image Understanding”.☆38Updated 5 months ago
- Code for AAAI 2023 Paper : “Alignment-Enriched Tuning for Patch-Level Pre-trained Document Image Models”☆17Updated 2 years ago
- [PR 2024] A large Cross-Modal Video Retrieval Dataset with Reading Comprehension☆24Updated last year
- This is the official repo for ByteVideoLLM/Dynamic-VLM☆20Updated 2 months ago
- ECCV2024_Parrot Captions Teach CLIP to Spot Text☆64Updated 6 months ago
- Exploring Efficient Fine-Grained Perception of Multimodal Large Language Models☆59Updated 4 months ago
- ☆19Updated last year
- ☆17Updated last month
- A huge dataset for Document Visual Question Answering☆15Updated 7 months ago
- Official Pytorch Implementation of Self-emerging Token Labeling☆32Updated 11 months ago
- ☆73Updated last year
- Synthetic data generation pipelines for text-rich images.☆44Updated last week
- INF-LLaVA: Dual-perspective Perception for High-Resolution Multimodal Large Language Model☆42Updated 7 months ago
- Official PyTorch Implementation of MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced …☆62Updated 3 months ago
- Implementation of the model: "(MC-ViT)" from the paper: "Memory Consolidation Enables Long-Context Video Understanding"☆21Updated last month
- [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…☆35Updated 8 months ago
- ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Exploration☆24Updated 2 months ago
- Pytorch implementation of HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Models☆28Updated 11 months ago
- MLLM-DataEngine: An Iterative Refinement Approach for MLLM☆44Updated 9 months ago
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆40Updated 8 months ago
- ☆33Updated last year
- [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…☆47Updated 4 months ago
- ☆39Updated 4 months ago
- ☆42Updated last month
- Code for our Paper "All in an Aggregated Image for In-Image Learning"☆29Updated 11 months ago
- The official repo of continuous speculative decoding☆24Updated 3 months ago
- [NeurIPS 2024] The official implementation of "Image Copy Detection for Diffusion Models"☆16Updated 5 months ago
- [ICLR2025] Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want☆66Updated last month