yuyq96 / TextHawk

Related projects ⓘ

Alternatives and complementary repositories for TextHawk

• OpenGVLab / MM-NIAH
  [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…
  ☆102Updated 3 weeks ago
• FudanNLPLAB / MouSi
  ☆73Updated 8 months ago
• yfzhang114 / SliME
  ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models
  ☆137Updated last week
• foundation-multimodal-models / CAL
  [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment
  ☆50Updated last month
• Ucas-HaoranWei / Vary-tiny-600k
  Vary-tiny codebase upon LAVIS （for training from scratch）and a PDF image-text pairs data (about 600k including English/Chinese)
  ☆68Updated 2 months ago
• TempleX98 / MoVA
  [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context
  ☆132Updated last month
• shufangxun / LLaVA-MoD
  Making LLaVA Tiny via MoE-Knowledge Distillation
  ☆60Updated 3 weeks ago
• TIGER-AI-Lab / VLM2Vec
  This repo contains the code and data for "VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks"
  ☆69Updated last week
• bzluan / TextCoT
  The official repo for “TextCoT: Zoom In for Enhanced Multimodal Text-Rich Image Understanding”.
  ☆33Updated last month
• X2FD / LVIS-INSTRUCT4V
  ☆131Updated 10 months ago
• bytedance / TextHarmony
  The official code for NeurIPS 2024 paper: Harmonizing Visual Text Comprehension and Generation
  ☆73Updated this week
• alibaba / conv-llava
  ☆105Updated 3 months ago
• Liuziyu77 / MMDU
  Official repository of MMDU dataset
  ☆75Updated last month
• thunlp / Muffin
  ☆58Updated 9 months ago
• THUDM / LVBench
  LVBench: An Extreme Long Video Understanding Benchmark
  ☆61Updated 2 months ago
• opendatalab / CLIP-Parrot-Bias
  ECCV2024_Parrot Captions Teach CLIP to Spot Text
  ☆60Updated 2 months ago
• LayTextLLM / LayTextLLM
  ☆67Updated this week
• ParadoxZW / LLaVA-UHD-Better
  A bug-free and improved implementation of LLaVA-UHD, based on the code from the official repo
  ☆31Updated 3 months ago
• bytedance / MTVQA
  MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answering. A comprehensive evaluation of multimodal large model multilingua…
  ☆45Updated last month
• HJYao00 / DenseConnector
  【NeurIPS 2024】Dense Connector for MLLMs
  ☆140Updated last month
• FreedomIntelligence / MLLM-Bench
  MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteria
  ☆55Updated last month
• SparksJoe / Prism
  A Framework for Decoupling and Assessing the Capabilities of VLMs
  ☆38Updated 4 months ago
• AFeng-x / Draw-and-Understand
  Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want
  ☆61Updated 3 weeks ago
• fh2019ustc / DeepEraser
  The official code for “DeepEraser: Deep Iterative Context Mining for Generic Text Eraser”, TMM, 2024.
  ☆28Updated 2 months ago
• Kevinz-code / SeVa
  [MM2024, oral] "Self-Supervised Visual Preference Alignment" https://arxiv.org/abs/2404.10501
  ☆41Updated 3 months ago
• kyegomez / PALI3
  Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
  ☆142Updated last week
• baaivision / EVE
  [NeurIPS'24 Spotlight] EVE: Encoder-Free Vision-Language Models
  ☆231Updated last month
• UniModal4Reasoning / SimChart9K
  The proposed simulated dataset consisting of 9,536 charts and associated data annotations in CSV format.
  ☆21Updated 8 months ago
• bytedance / Portrait-Mode-Video
  Video dataset dedicated to portrait-mode video recognition.
  ☆36Updated 7 months ago
• TIGER-AI-Lab / Mantis
  Official code for Paper "Mantis: Multi-Image Instruction Tuning" (TMLR2024)
  ☆184Updated this week