percent4 / multi-modal-image-searchLinks
本项目使用LLaVA 1.6多模态模型实现以文搜图和以图搜图功能。
☆23Updated last year
Alternatives and similar repositories for multi-modal-image-search
Users that are interested in multi-modal-image-search are comparing it to the libraries listed below
Sorting:
- [ACL 2025 Oral] 🔥🔥 MegaPairs: Massive Data Synthesis for Universal Multimodal Retrieval☆204Updated last month
- Here is a demo for PDF parser (Including OCR, object detection tools)☆35Updated 9 months ago
- A Simple MLLM Surpassed QwenVL-Max with OpenSource Data Only in 14B LLM.☆37Updated 10 months ago
- ☆39Updated 9 months ago
- Vision Search Assistant: Empower Vision-Language Models as Multimodal Search Engines☆125Updated 8 months ago
- 从零到一实现了一个多模态大模型,并命名为Reyes(睿视),R:睿,eyes:眼。Reyes的参数量为8B,视觉编码器使用的是InternViT-300M-448px-V2_5,语言模型侧使用的是Qwen2.5-7B-Instruct,Reyes也通过一个两层MLP投影层连…☆21Updated 5 months ago
- ☆57Updated last year
- Research Code for Multimodal-Cognition Team in Ant Group☆154Updated last week
- 训练一个对中文支持更好的LLaVA模型,并开源训练代码和数据。☆64Updated 10 months ago
- ☆173Updated 5 months ago
- ☆28Updated 11 months ago
- Multimodal Open-O1 (MO1) is designed to enhance the accuracy of inference models by utilizing a novel prompt-based approach. This tool wo…☆29Updated 9 months ago
- ☆80Updated last year
- Valley is a cutting-edge multimodal large model designed to handle a variety of tasks involving text, images, and video data.☆244Updated 4 months ago
- official code for "Fox: Focus Anywhere for Fine-grained Multi-page Document Understanding"☆151Updated last year
- A Survey of Multimodal Retrieval-Augmented Generation☆18Updated 3 months ago
- Multimodal chatbot with computer vision capabilities integrated, our 1st-gen LMM☆101Updated last year
- GLM Series Edge Models☆144Updated last month
- Our 2nd-gen LMM☆33Updated last year
- ☆28Updated last year
- Repo for "VRAG-RL: Empower Vision-Perception-Based RAG for Visually Rich Information Understanding via Iterative Reasoning with Reinforce…☆280Updated 2 weeks ago
- Xtuner Factory☆33Updated last year
- MDocAgent: A Multi-Modal Multi-Agent Framework for Document Understanding☆189Updated 3 months ago
- Chinese CLIP models with SOTA performance.☆55Updated last year
- The huggingface implementation of Fine-grained Late-interaction Multi-modal Retriever.☆92Updated last month
- In this fast-paced world, we all need a little something to spice up life. Whether you need a glass of sweet talk to lift your spirits or…☆58Updated last month
- 一些大语言模型和多模态模型的生态,主要包括跨模态搜索、投机解码、QAT量化、多模态量化、ChatBot、OCR☆184Updated 3 weeks ago
- 基于baichuan-7b的开源多模态大语言模型☆73Updated last year
- Repo for Benchmarking Multimodal Retrieval Augmented Generation with Dynamic VQA Dataset and Self-adaptive Planning Agent☆350Updated 2 months ago
- a tiny project to test the effectiveness of video QA through RAG techniques and multimodal LLMs☆15Updated last year