bytedance / TextHarmony
The official code for NeurIPS 2024 paper: Harmonizing Visual Text Comprehension and Generation
☆65Updated last month
Related projects ⓘ
Alternatives and complementary repositories for TextHarmony
- Exploring Efficient Fine-Grained Perception of Multimodal Large Language Models☆51Updated last week
- Vary-tiny codebase upon LAVIS (for training from scratch)and a PDF image-text pairs data (about 600k including English/Chinese)☆68Updated last month
- ☆156Updated 8 months ago
- The official repo for “TextCoT: Zoom In for Enhanced Multimodal Text-Rich Image Understanding”.☆32Updated last month
- Research Code for Multimodal-Cognition Team in Ant Group☆122Updated 4 months ago
- ☆64Updated this week
- Evaluation of the Optical Character Recognition (OCR) capabilities of GPT-4V(ision)☆120Updated 11 months ago
- 【ArXiv】PDF-Wukong: A Large Multimodal Model for Efficient Long PDF Reading with End-to-End Sparse Sampling☆93Updated 3 weeks ago
- official code for "Fox: Focus Anywhere for Fine-grained Multi-page Document Understanding"☆127Updated 5 months ago
- ☆77Updated 6 months ago
- Official implementation of ViTEraser: Harnessing the Power of Vision Transformers for Scene Text Removal with SegMIM Pretraining (AAAI 20…☆42Updated 4 months ago
- ☆55Updated 9 months ago
- Document Artifical Intelligence☆127Updated last month
- ☆112Updated 8 months ago
- The official code for the CVPR 2024 paper: Multi-modal In-Context Learning Makes an Ego-evolving Scene Text Recognizer☆44Updated 4 months ago
- Official implementation of UPOCR: Towards unified pixel-level OCR interface (ICML 2024)☆39Updated 5 months ago
- A Simple MLLM Surpassed QwenVL-Max with OpenSource Data Only in 14B LLM.☆36Updated 2 months ago
- ☆66Updated last year
- [NAACL 2024] Visually Guided Generative Text-Layout Pre-training for Document Intelligence☆48Updated 2 months ago
- ☆67Updated this week
- MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answering. A comprehensive evaluation of multimodal large model multilingua…☆45Updated last month
- ☆82Updated 10 months ago
- The official code for “DeepEraser: Deep Iterative Context Mining for Generic Text Eraser”, TMM, 2024.☆28Updated 2 months ago
- Precision Search through Multi-Style Inputs☆54Updated 3 months ago
- An open-source implementaion for fine-tuning Qwen2-VL series by Alibaba Cloud.☆106Updated last week
- ☆73Updated 8 months ago
- ☆40Updated last year
- VimTS: A Unified Video and Image Text Spotter☆72Updated this week
- Text-To-Image Generation with Chinese Characters☆118Updated last year
- The huggingface implementation of Fine-grained Late-interaction Multi-modal Retriever.☆68Updated 2 months ago