Alternatives and similar repositories for TextHawk

Users that are interested in TextHawk are comparing it to the libraries listed below

• OpenGVLab / MM-NIAH
  [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…
  ☆117Updated 6 months ago
• alibaba / conv-llava
  ☆115Updated 10 months ago
• bzluan / TextCoT
  The official repo for “TextCoT: Zoom In for Enhanced Multimodal Text-Rich Image Understanding”.
  ☆40Updated 8 months ago
• Alpha-Innovator / SimChart9K
  The proposed simulated dataset consisting of 9,536 charts and associated data annotations in CSV format.
  ☆25Updated last year
• allenai / pixmo-docs
  ACL 2025: Synthetic data generation pipelines for text-rich images.
  ☆79Updated 3 months ago
• thunlp / Muffin
  ☆64Updated last year
• Token-family / TokenFD
  A Token-level Text Image Foundation Model for Document Understanding
  ☆96Updated last month
• ParadoxZW / LLaVA-UHD-Better
  A bug-free and improved implementation of LLaVA-UHD, based on the code from the official repo
  ☆34Updated 10 months ago
• Liuziyu77 / MMDU
  Official repository of MMDU dataset
  ☆92Updated 8 months ago
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆104Updated 3 weeks ago
• IDEA-FinAI / RagVL
  Official PyTorch Implementation of MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced …
  ☆78Updated 7 months ago
• FudanNLPLAB / MouSi
  ☆73Updated last year
• Ucas-HaoranWei / Slow-Perception
  Official code implementation of Slow Perception:Let's Perceive Geometric Figures Step-by-step
  ☆129Updated 4 months ago
• Ucas-HaoranWei / Vary-tiny-600k
  Vary-tiny codebase upon LAVIS （for training from scratch）and a PDF image-text pairs data (about 600k including English/Chinese)
  ☆84Updated 9 months ago
• HZQ950419 / Math-LLaVA
  Code for Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models
  ☆84Updated 11 months ago
• OpenGVLab / V2PE
  [ArXiv] V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encoding
  ☆50Updated 6 months ago
• jinbo0906 / Awesome-MLLM-Datasets
  This project aims to collect and collate various datasets for multimodal large model training, including but not limited to pre-training …
  ☆48Updated last month
• foundation-multimodal-models / CAL
  [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment
  ☆56Updated 8 months ago
• yfzhang114 / SliME
  ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models
  ☆159Updated 5 months ago
• opendatalab / MLLM-DataEngine
  MLLM-DataEngine: An Iterative Refinement Approach for MLLM
  ☆46Updated last year
• mayubo2333 / MMLongBench-Doc
  Official Repository of MMLONGBENCH-DOC: Benchmarking Long-context Document Understanding with Visualizations
  ☆82Updated 11 months ago
• LukeForeverYoung / UReader
  ☆136Updated last year
• X2FD / LVIS-INSTRUCT4V
  ☆133Updated last year
• zwq2018 / Multi-modal-Self-instruct
  The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…
  ☆79Updated 4 months ago
• RifleZhang / LLaVA-Reasoner-DPO
  ☆78Updated 5 months ago
• ding523 / Curr_REFT
  ☆61Updated last month
• PanguIR / MRAGSurvey
  A Survey of Multimodal Retrieval-Augmented Generation
  ☆18Updated 2 months ago
• Kevinz-code / SeVa
  [MM2024, oral] "Self-Supervised Visual Preference Alignment" https://arxiv.org/abs/2404.10501
  ☆55Updated 10 months ago
• AFeng-x / Draw-and-Understand
  [ICLR2025] Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want
  ☆76Updated 2 weeks ago
• yuecao0119 / MMInstruct
  [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…
  ☆54Updated 7 months ago