Alternatives and similar repositories for RAG-with-open-source-multi-modal:

Users that are interested in RAG-with-open-source-multi-modal are comparing it to the libraries listed below

• LinWeizheDragon / FLMR
  The huggingface implementation of Fine-grained Late-interaction Multi-modal Retriever.
  ☆82Updated last month
• GaiZhenbiao / Phi3V-Finetuning
  Parameter-efficient finetuning script for Phi-3-vision, the strong multimodal language model by Microsoft.
  ☆57Updated 8 months ago
• opendatalab / OHR-Bench
  OCR Hinders RAG: Evaluating the Cascading Impact of OCR on Retrieval-Augmented Generation
  ☆67Updated last month
• Vision-CAIR / dochaystacks
  ☆16Updated last month
• bhimrazy / chat-with-qwen2-vl
  Chat with Qwen2-VL. Qwen2-VL is the multimodal large language model series developed by Qwen team, Alibaba Cloud.
  ☆10Updated 5 months ago
• IDEA-FinAI / RagVL
  Official PyTorch Implementation of MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced …
  ☆60Updated 3 months ago
• harrytea / TGDoc
  arXiv 23 "Towards Improving Document Understanding: An Exploration on Text-Grounding via MLLMs"
  ☆14Updated 3 months ago
• haihua0913 / awesome-dq4ml
  Useful resources on data quality for machine learning and artificial intelligence.
  ☆18Updated last week
• bhimrazy / chat-with-phi-3-vision
  Chat with Phi 3.5/3 Vision LLMs. Phi-3.5-vision is a lightweight, state-of-the-art open multimodal model built upon datasets which includ…
  ☆33Updated 2 months ago
• waltonfuture / InstructionGPT-4
  InstructionGPT-4
  ☆39Updated last year
• om-ai-lab / ZoomEye
  ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Exploration
  ☆24Updated 2 months ago
• PKU-YuanGroup / LLaVA-o1
  ☆55Updated 3 months ago
• showlab / assistgpt
  ☆65Updated last year
• riedlerm / multimodal_rag_for_industry
  Implementation and evaluation of multimodal RAG with text and image inputs for industrial applications
  ☆38Updated 3 months ago
• XiaoduoAILab / XmodelVLM
  ☆68Updated 8 months ago
• bzluan / TextCoT
  The official repo for “TextCoT: Zoom In for Enhanced Multimodal Text-Rich Image Understanding”.
  ☆38Updated 5 months ago
• fangyuan-ksgk / Mini-LLaVA
  A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.
  ☆89Updated 2 months ago
• neulab / MultiUI
  Code for Paper: Harnessing Webpage Uis For Text Rich Visual Understanding
  ☆48Updated 2 months ago
• dinobby / MAgICoRE
  ☆23Updated 5 months ago
• kyegomez / LIMoE
  Implementation of the "the first large-scale multimodal mixture of experts models." from the paper: "Multimodal Contrastive Learning with…
  ☆26Updated last month
• MCR-PEFT / Ex-MCR
  ☆41Updated last year
• RustamyF / clip-multimodal-ml
  ☆57Updated last year
• FudanNLPLAB / MouSi
  ☆73Updated 11 months ago
• agiresearch / AutoFlow
  ☆54Updated 5 months ago
• RhapsodyAILab / MiniCPM-V-Embedding
  ☆28Updated 6 months ago
• LHBuilder / SA-Segment-Anything
  Vision-oriented multimodal AI
  ☆49Updated 8 months ago
• yuyq96 / TextHawk
  Exploring Efficient Fine-Grained Perception of Multimodal Large Language Models
  ☆59Updated 4 months ago
• DAMO-NLP-SG / multimodal_textbook
  The official repository for "2.5 Years in Class: A Multimodal Textbook for Vision-Language Pretraining"
  ☆142Updated last month
• open-compass / CompassJudger
  ☆87Updated last week