nttmdlab-nlp / VDocRAGLinks
[CVPR2025] VDocRAG: Retirval-Augmented Generation over Visually-Rich Documents
☆50Updated 5 months ago
Alternatives and similar repositories for VDocRAG
Users that are interested in VDocRAG are comparing it to the libraries listed below
Sorting:
- Official PyTorch Implementation of MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced …☆86Updated last year
- [ACM MM 2025] The official code of "Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs"☆95Updated last week
- The official repo for “TextCoT: Zoom In for Enhanced Multimodal Text-Rich Image Understanding”.☆44Updated last year
- The official implementation of the paper "MMFuser: Multimodal Multi-Layer Feature Fuser for Fine-Grained Vision-Language Understanding". …☆59Updated last year
- ☆62Updated 3 months ago
- The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…☆84Updated 9 months ago
- [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…☆59Updated last year
- ☆38Updated 3 months ago
- SophiaVL-R1: Reinforcing MLLMs Reasoning with Thinking Reward☆86Updated 3 months ago
- ☆72Updated 6 months ago
- 🔥🔥[NeurIPS2025]Exploring and mitigating semantic hallucinations in scene text perception and reasoning☆19Updated last month
- Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*☆109Updated 5 months ago
- [MTI-LLM@NeurIPS 2025] Official implementation of "PyVision: Agentic Vision with Dynamic Tooling."☆134Updated 4 months ago
- [EMNLP-2025 Oral] ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Exploration☆61Updated 2 months ago
- Code for paper: Reinforced Vision Perception with Tools☆61Updated last month
- [ICCV 2025] Dynamic-VLM☆26Updated 11 months ago
- SFT+RL boosts multimodal reasoning☆37Updated 4 months ago
- ☆99Updated 10 months ago
- Exploring Efficient Fine-Grained Perception of Multimodal Large Language Models☆64Updated last year
- MLLM @ Game☆14Updated 6 months ago
- [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context☆168Updated last year
- The huggingface implementation of Fine-grained Late-interaction Multi-modal Retriever.☆101Updated 5 months ago
- [TMLR 25] SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models☆139Updated last month
- Scaling Multi-modal Instruction Fine-tuning with Tens of Thousands Vision Task Types☆32Updated 4 months ago
- ☆123Updated last year
- DeepPerception: Advancing R1-like Cognitive Visual Perception in MLLMs for Knowledge-Intensive Visual Grounding☆65Updated 5 months ago
- [EMNLP 2025] Distill Visual Chart Reasoning Ability from LLMs to MLLMs☆57Updated 2 months ago
- Official implement of MIA-DPO☆67Updated 9 months ago
- ABC: Achieving Better Control of Multimodal Embeddings using VLMs [TMLR2025]☆17Updated 3 months ago
- "Towards Improving Document Understanding: An Exploration on Text-Grounding via MLLMs" 2023☆16Updated 11 months ago