Alternatives and similar repositories for MRAGSurvey:

Users that are interested in MRAGSurvey are comparing it to the libraries listed below

• Token-family / TokenFD
  A Token-level Text Image Foundation Model for Document Understanding
  ☆91Updated this week
• yuyq96 / TextHawk
  Exploring Efficient Fine-Grained Perception of Multimodal Large Language Models
  ☆60Updated 6 months ago
• IDEA-FinAI / RagVL
  Official PyTorch Implementation of MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced …
  ☆70Updated 5 months ago
• mayubo2333 / MMLongBench-Doc
  Official Repository of MMLONGBENCH-DOC: Benchmarking Long-context Document Understanding with Visualizations
  ☆80Updated 9 months ago
• bytedance / MTVQA
  MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answering. A comprehensive evaluation of multimodal large model multilingua…
  ☆56Updated last month
• LinWeizheDragon / FLMR
  The huggingface implementation of Fine-grained Late-interaction Multi-modal Retriever.
  ☆86Updated 3 months ago
• VectorSpaceLab / MegaPairs
  MegaPairs: Massive Data Synthesis For Universal Multimodal Retrieval
  ☆157Updated 3 weeks ago
• bzluan / TextCoT
  The official repo for “TextCoT: Zoom In for Enhanced Multimodal Text-Rich Image Understanding”.
  ☆39Updated 7 months ago
• sakura2233565548 / TabPedia
  This repository is the codebase of TabPedia: Towards Comprehensive Visual Table Understanding with Concept Synergy
  ☆34Updated 6 months ago
• bytedance / TextHarmony
  The official code for NeurIPS 2024 paper: Harmonizing Visual Text Comprehension and Generation
  ☆119Updated 5 months ago
• Liuziyu77 / MMDU
  Official repository of MMDU dataset
  ☆89Updated 7 months ago
• RhapsodyAILab / MiniCPM-V-Embedding
  ☆29Updated 8 months ago
• LayTextLLM / LayTextLLM
  ☆88Updated 4 months ago
• Ucas-HaoranWei / Vary-tiny-600k
  Vary-tiny codebase upon LAVIS （for training from scratch）and a PDF image-text pairs data (about 600k including English/Chinese)
  ☆82Updated 7 months ago
• alipay / Ant-Multi-Modal-Framework
  Research Code for Multimodal-Cognition Team in Ant Group
  ☆143Updated 9 months ago
• Ucas-HaoranWei / Vary-family
  ☆56Updated last year
• OpenGVLab / V2PE
  [ArXiv] V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encoding
  ☆46Updated 4 months ago
• yh-hust / PDF-Wukong
  【ArXiv】PDF-Wukong: A Large Multimodal Model for Efficient Long PDF Reading with End-to-End Sparse Sampling
  ☆116Updated 6 months ago
• OpenGVLab / MM-NIAH
  [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…
  ☆116Updated 5 months ago
• yujunhuics / Reyes
  从零到一实现了一个多模态大模型，并命名为Reyes（睿视），R：睿，eyes：眼。Reyes的参数量为8B，视觉编码器使用的是InternViT-300M-448px-V2_5,语言模型侧使用的是Qwen2.5-7B-Instruct，Reyes也通过一个两层MLP投影层连…
  ☆12Updated 2 months ago
• zhourax / VEGA
  ☆36Updated 10 months ago
• LengSicong / MMR1
  MMR1: Advancing the Frontiers of Multimodal Reasoning
  ☆159Updated last month
• jinbo0906 / Awesome-MLLM-Datasets
  This project aims to collect and collate various datasets for multimodal large model training, including but not limited to pre-training …
  ☆43Updated this week
• ggg0919 / cantor
  ☆83Updated 11 months ago
• JUNJIE99 / VISTA_Evaluation_FineTuning
  Evaluation code and datasets for the ACL 2024 paper, VISTA: Visualized Text Embedding for Universal Multi-Modal Retrieval. The original c…
  ☆37Updated 5 months ago
• MonolithFoundation / Bumblebee
  A Simple MLLM Surpassed QwenVL-Max with OpenSource Data Only in 14B LLM.
  ☆37Updated 8 months ago
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆100Updated 2 months ago
• thu-ml / zh-clip
  ☆67Updated last year
• FudanNLPLAB / MouSi
  ☆73Updated last year
• RLHF-V / RLHF-V
  [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback
  ☆276Updated 7 months ago