Alternatives and similar repositories for RAG-with-open-source-multi-modal

Users that are interested in RAG-with-open-source-multi-modal are comparing it to the libraries listed below

• LinWeizheDragon / FLMR
  The huggingface implementation of Fine-grained Late-interaction Multi-modal Retriever.
  ☆87Updated 3 months ago
• GaiZhenbiao / Phi3V-Finetuning
  Parameter-efficient finetuning script for Phi-3-vision, the strong multimodal language model by Microsoft.
  ☆58Updated 11 months ago
• opendatalab / OHR-Bench
  OCR Hinders RAG: Evaluating the Cascading Impact of OCR on Retrieval-Augmented Generation
  ☆74Updated last month
• yihedeng9 / OpenVLThinker
  OpenVLThinker: An Early Exploration to Vision-Language Reasoning via Iterative Self-Improvement
  ☆84Updated last week
• riedlerm / multimodal_rag_for_industry
  Implementation and evaluation of multimodal RAG with text and image inputs for industrial applications
  ☆49Updated 6 months ago
• bhimrazy / chat-with-phi-3-vision
  Chat with Phi 3.5/3 Vision LLMs. Phi-3.5-vision is a lightweight, state-of-the-art open multimodal model built upon datasets which includ…
  ☆33Updated 4 months ago
• stanfordmlgroup / ManyICL
  ☆140Updated 11 months ago
• deepglint / UniME
  The official code of "Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs"
  ☆69Updated last week
• waltonfuture / InstructionGPT-4
  InstructionGPT-4
  ☆39Updated last year
• bzluan / TextCoT
  The official repo for “TextCoT: Zoom In for Enhanced Multimodal Text-Rich Image Understanding”.
  ☆39Updated 7 months ago
• fangyuan-ksgk / Mini-LLaVA
  A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.
  ☆91Updated 5 months ago
• IDEA-FinAI / RagVL
  Official PyTorch Implementation of MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced …
  ☆75Updated 6 months ago
• Victorwz / LLaVA-Llama-3
  Reproduction of LLaVA-v1.5 based on Llama-3-8b LLM backbone.
  ☆65Updated 6 months ago
• alexander-moore / vlm
  Composition of Multimodal Language Models From Scratch
  ☆14Updated 9 months ago
• dame-cell / VisionRAG
  A new novel multi-modality (Vision) RAG architecture
  ☆27Updated 7 months ago
• XiaoduoAILab / XmodelVLM
  ☆68Updated 10 months ago
• Omaralsaabi / M3DOCRAG
  An implementation of "M3DOCRAG: Multi-modal Retrieval is What You Need for Multi-page Multi-document Understanding" by Jaemin Cho, Debanj…
  ☆36Updated 6 months ago
• RhapsodyAILab / MiniCPM-V-Embedding
  ☆29Updated 8 months ago
• Leon1207 / Video-RAG-master
  This is the official implementation of our paper "Video-RAG: Visually-aligned Retrieval-Augmented Long Video Comprehension"
  ☆187Updated 2 months ago
• showlab / assistgpt
  ☆66Updated last year
• 01yzzyu / wikiautogen
  ☆14Updated last month
• PKU-YuanGroup / LLaVA-o1
  ☆57Updated 5 months ago
• swordlidev / Evaluation-Multimodal-LLMs-Survey
  A Survey on Benchmarks of Multimodal Large Language Models
  ☆103Updated last month
• JiuTian-VL / JiuTian-LION
  [CVPR 2024] LION: Empowering Multimodal Large Language Model with Dual-Level Visual Knowledge
  ☆140Updated 10 months ago
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆100Updated 2 months ago
• Vision-CAIR / dochaystacks
  Document Haystacks: Vision-Language Reasoning Over Piles of 1000+ Documents, CVPR 2025
  ☆18Updated 3 months ago
• RifleZhang / LLaVA-Reasoner-DPO
  ☆75Updated 4 months ago
• kyegomez / LIMoE
  Implementation of the "the first large-scale multimodal mixture of experts models." from the paper: "Multimodal Contrastive Learning with…
  ☆29Updated last month
• kdr / videoRAG-mrr2024
  Supporting code for: Video Enriched Retrieval Augmented Generation Using Aligned Video Captions
  ☆26Updated 9 months ago
• aiming-lab / MDocAgent
  MDocAgent: A Multi-Modal Multi-Agent Framework for Document Understanding
  ☆145Updated last month