nadsoft-opensource / RAG-with-open-source-multi-modal

Related projects ⓘ

Alternatives and complementary repositories for RAG-with-open-source-multi-modal

• LinWeizheDragon / FLMR
  The huggingface implementation of Fine-grained Late-interaction Multi-modal Retriever.
  ☆69Updated 2 months ago
• fangyuan-ksgk / Mini-LLaVA
  A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.
  ☆84Updated 2 months ago
• bzluan / TextCoT
  The official repo for “TextCoT: Zoom In for Enhanced Multimodal Text-Rich Image Understanding”.
  ☆35Updated last month
• Victorwz / LLaVA-Llama-3
  Reproduction of LLaVA-v1.5 based on Llama-3-8b LLM backbone.
  ☆59Updated 3 weeks ago
• TempleX98 / MoVA
  [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context
  ☆132Updated last month
• GaiZhenbiao / Phi3V-Finetuning
  Parameter-efficient finetuning script for Phi-3-vision, the strong multimodal language model by Microsoft.
  ☆54Updated 5 months ago
• LHBuilder / SA-Segment-Anything
  Vision-oriented multimodal AI
  ☆49Updated 5 months ago
• waltonfuture / InstructionGPT-4
  InstructionGPT-4
  ☆37Updated 10 months ago
• riedlerm / multimodal_rag_for_industry
  Implementation and evaluation of multimodal RAG with text and image inputs for industrial applications
  ☆24Updated 2 weeks ago
• WillDreamer / Aurora
  [NeurIPS2023] Parameter-efficient Tuning of Large-scale Multimodal Foundation Model
  ☆83Updated 11 months ago
• yuyq96 / TextHawk
  Exploring Efficient Fine-Grained Perception of Multimodal Large Language Models
  ☆53Updated 3 weeks ago
• kyegomez / PALI3
  Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
  ☆142Updated last week
• showlab / assistgpt
  ☆65Updated last year
• swordlidev / Evaluation-Multimodal-LLMs-Survey
  A Survey on Benchmarks of Multimodal Large Language Models
  ☆65Updated last month
• 360CVGroup / 360VL
  ☆30Updated 6 months ago
• harrytea / TGDoc
  arXiv 23 "Towards Improving Document Understanding: An Exploration on Text-Grounding via MLLMs"
  ☆13Updated 9 months ago
• alibaba / GeoGPT4V
  ☆12Updated 4 months ago
• jihaonew / MM-Instruct
  MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment
  ☆31Updated 4 months ago
• iancovert / locality-alignment
  ☆30Updated last week
• kyegomez / LIMoE
  Implementation of the "the first large-scale multimodal mixture of experts models." from the paper: "Multimodal Contrastive Learning with…
  ☆23Updated last week
• TIGER-AI-Lab / VLM2Vec
  This repo contains the code and data for "VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks"
  ☆74Updated last week
• JiuTian-VL / JiuTian-LION
  [CVPR 2024] LION: Empowering Multimodal Large Language Model with Dual-Level Visual Knowledge
  ☆122Updated 4 months ago
• NVlabs / STL
  Official Pytorch Implementation of Self-emerging Token Labeling
  ☆30Updated 7 months ago
• IDEA-FinAI / RagVL
  Official PyTorch Implementation of MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced …
  ☆38Updated last week
• AGI-Edgerunners / IIL
  Code for our Paper "All in an Aggregated Image for In-Image Learning"
  ☆29Updated 7 months ago
• SY-Xuan / Pink
  Pink: Unveiling the Power of Referential Comprehension for Multi-modal LLMs
  ☆77Updated 5 months ago
• stanfordmlgroup / ManyICL
  ☆128Updated 5 months ago
• artemisp / LAVIS-XInstructBLIP
  LAVIS - A One-stop Library for Language-Vision Intelligence
  ☆47Updated 3 months ago
• WatchTower-Liu / VLM-learning
  Building a VLM model starts from the basic module.
  ☆10Updated 7 months ago
• UbiquitousLearning / SLM_Survey
  ☆63Updated last month