nttmdlab-nlp / VDocRAGLinks
[CVPR2025] VDocRAG: Retirval-Augmented Generation over Visually-Rich Documents
☆31Updated last month
Alternatives and similar repositories for VDocRAG
Users that are interested in VDocRAG are comparing it to the libraries listed below
Sorting:
- "Towards Improving Document Understanding: An Exploration on Text-Grounding via MLLMs" 2023☆14Updated 7 months ago
- ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Exploration☆46Updated 6 months ago
- MLLM-DataEngine: An Iterative Refinement Approach for MLLM☆46Updated last year
- OLA-VLM: Elevating Visual Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024☆60Updated 4 months ago
- iLLaVA: An Image is Worth Fewer Than 1/3 Input Tokens in Large Multimodal Models☆19Updated 5 months ago
- The official implementation of the paper "MMFuser: Multimodal Multi-Layer Feature Fuser for Fine-Grained Vision-Language Understanding". …☆56Updated 8 months ago
- [ACM MM25] The official code of "Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs"☆80Updated last week
- LMM solved catastrophic forgetting, AAAI2025☆44Updated 3 months ago
- Official implementation of "PyVision: Agentic Vision with Dynamic Tooling."☆24Updated this week
- ☆42Updated 8 months ago
- [EMNLP 2024] Official code for "Beyond Embeddings: The Promise of Visual Table in Multi-Modal Models"☆20Updated 9 months ago
- SophiaVL-R1: Reinforcing MLLMs Reasoning with Thinking Reward☆57Updated 3 weeks ago
- ECCV2024_Parrot Captions Teach CLIP to Spot Text☆66Updated 10 months ago
- Official Pytorch Implementation of Self-emerging Token Labeling☆34Updated last year
- Official PyTorch Implementation of MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced …☆78Updated 8 months ago
- Exploring Efficient Fine-Grained Perception of Multimodal Large Language Models☆62Updated 8 months ago
- survery of small language models☆15Updated 11 months ago
- MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment☆35Updated last year
- [ICCV 2025] Dynamic-VLM☆23Updated 7 months ago
- Scaling Multi-modal Instruction Fine-tuning with Tens of Thousands Vision Task Types☆24Updated this week
- Evaluation and dataset construction code for the CVPR 2025 paper "Vision-Language Models Do Not Understand Negation"☆26Updated 2 months ago
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆44Updated last year
- ☆64Updated last month
- Code for paper: Unified Text-to-Image Generation and Retrieval☆15Updated last year
- ☆73Updated last year
- [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…☆55Updated 8 months ago
- Unsupervised GRPO☆38Updated last month
- Code for our Paper "All in an Aggregated Image for In-Image Learning"☆30Updated last year
- [PR 2024] A large Cross-Modal Video Retrieval Dataset with Reading Comprehension☆26Updated last year
- WeGeFT: Weight‑Generative Fine‑Tuning for Multi‑Faceted Efficient Adaptation of Large Models☆20Updated last week