Exploring Efficient Fine-Grained Perception of Multimodal Large Language Models
☆66Nov 1, 2024Updated last year
Alternatives and similar repositories for TextHawk
Users that are interested in TextHawk are comparing it to the libraries listed below
Sorting:
- Code and data for the paper: DTSM: Toward Dense Table Structure Recognition with Text Query Encoder and Adjacent Feature Aggregator☆12Apr 28, 2024Updated last year
- 【NeurIPS 2024】Dense Connector for MLLMs☆181Oct 14, 2024Updated last year
- Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)☆35Mar 7, 2025Updated 11 months ago
- ☆11Oct 31, 2024Updated last year
- ☆34Oct 9, 2025Updated 4 months ago
- [ICCV2025] A Token-level Text Image Foundation Model for Document Understanding☆132Aug 27, 2025Updated 6 months ago
- [TIM 2025] Towards Accurate Readings of Water Meters by Eliminating Transition Error: New Dataset and Effective Solution☆12Mar 5, 2025Updated 11 months ago
- [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…☆80Jun 17, 2024Updated last year
- The official repo for “WildDoc: How Far Are We from Achieving Comprehensive and Robust Document Understanding in the Wild?“☆71May 19, 2025Updated 9 months ago
- ☆39May 20, 2025Updated 9 months ago
- Code for Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models☆92Jun 28, 2024Updated last year
- ☆21Jul 24, 2025Updated 7 months ago
- [AAAI'26] Steering One-Step Diffusion Model with Fidelity-Rich Decoder for Fast Image Compression☆19Dec 21, 2025Updated 2 months ago
- Official implementation of the paper: "A deeper look at depth pruning of LLMs"☆15Jul 24, 2024Updated last year
- The official implement of CTRNet++.☆14Dec 30, 2024Updated last year
- [ECCV 2022] MORE: Multi-Order RElation Mining for Dense Captioning in 3D Scenes official implementation☆16Feb 2, 2023Updated 3 years ago
- 基于TrOCR + UniMER-1M数据集，训练一个小而美的公式识别模型☆29Jun 23, 2025Updated 8 months ago
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM", IJCV2025☆276May 26, 2025Updated 9 months ago
- Research without Re-search: Maximal Update Parametrization Yields Accurate Loss Prediction across Scales☆32Jul 17, 2023Updated 2 years ago
- Official code for DocNLC: A Document Image Enhancement Framework with Normalized and Latent Contrastive Representation for Multiple Degra…☆39May 28, 2025Updated 9 months ago
- a lightweight C++ LLaMA inference engine for mobile devices☆15Oct 28, 2023Updated 2 years ago
- Improving large language models with concept-aware fine-tuning (CAFT)☆29Jan 31, 2026Updated last month
- ☆24May 23, 2025Updated 9 months ago
- [CVPR 2025] DocLayLLM: An Efficient Multi-modal Extension of Large Language Models for Text-rich Document Understanding☆27Dec 18, 2025Updated 2 months ago
- Extending context length of visual language models☆12Dec 18, 2024Updated last year
- Set-Encoder: Permutation-Invariant Inter-Passage Attention for Listwise Passage Re-Ranking with Cross-Encoders☆18May 23, 2025Updated 9 months ago
- [AAAI 2026] Global Compression Commander: Plug-and-Play Inference Acceleration for High-Resolution Large Vision-Language Models☆38Jan 27, 2026Updated last month
- Learning 1D Causal Visual Representation with De-focus Attention Networks☆35Jun 7, 2024Updated last year
- WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMs☆41Jan 26, 2026Updated last month
- MegaRAG: Multimodal Graph-based RAG☆36Sep 16, 2025Updated 5 months ago
- ☆16Apr 7, 2024Updated last year
- ☆142Feb 13, 2024Updated 2 years ago
- Matryoshka Multimodal Models☆122Jan 22, 2025Updated last year
- [NeurIPS 2025 Spotlight] Official PyTorch implementation of Vgent☆42Nov 30, 2025Updated 3 months ago
- A Recipe for Building LLM Reasoners to Solve Complex Instructions☆29Oct 9, 2025Updated 4 months ago
- ☆25Jun 18, 2025Updated 8 months ago
- Codes for ICLR 2025 Paper: Towards Semantic Equivalence of Tokenization in Multimodal LLM☆79Apr 19, 2025Updated 10 months ago
- ☆37Sep 16, 2024Updated last year
- InstructDoc: A Dataset for Zero-Shot Generalization of Visual Document Understanding with Instructions (AAAI2024)☆162May 31, 2024Updated last year