WatchTower-Liu / VLM-learningLinks
Building a VLM model starts from the basic module.
☆16Updated last year
Alternatives and similar repositories for VLM-learning
Users that are interested in VLM-learning are comparing it to the libraries listed below
Sorting:
- ☆25Updated 9 months ago
- Build a simple basic multimodal large model from scratch. 从零搭建一个简单的基础多模态大模型🤖☆40Updated 11 months ago
- A multimodal image search engine built on the GME model, capable of handling diverse input types. Whether you're querying with text, imag…☆36Updated 5 months ago
- 训练一个对中文支持更好的LLaVA模型，并开源训练代码和数据。☆59Updated 9 months ago
- 从零到一实现了一个多模态大 模型，并命名为Reyes（睿视），R：睿，eyes：眼。Reyes的参数量为8B，视觉编码器使用的是InternViT-300M-448px-V2_5,语言模型侧使用的是Qwen2.5-7B-Instruct，Reyes也通过一个两层MLP投影层连…☆13Updated 3 months ago
- ☆56Updated last year
- Research Code for Multimodal-Cognition Team in Ant Group☆147Updated 2 weeks ago
- This project aims to collect and collate various datasets for multimodal large model training, including but not limited to pre-training …☆47Updated 3 weeks ago
- WWW2025 Multimodal Intent Recognition for Dialogue Systems Challenge☆123Updated 6 months ago
- 模型 llava-Qwen2-7B-Instruct-Chinese-CLIP 增强中文文字识别能力和表情包内涵识别能力，接近gpt4o、claude-3.5-sonnet的识别水平！☆23Updated 10 months ago
- 一些大语言模型和多模态模型的应用,主要包括小模型，Agent，跨模态搜索，OCR、RAG、ChatBot等等☆171Updated 3 weeks ago
- The official repo for “TextCoT: Zoom In for Enhanced Multimodal Text-Rich Image Understanding”.☆40Updated 8 months ago
- The official code of "Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs"☆73Updated 2 weeks ago
- A Token-level Text Image Foundation Model for Document Understanding☆92Updated last month
- MegaPairs: Massive Data Synthesis For Universal Multimodal Retrieval☆181Updated 2 weeks ago
- 通义千问的DPO训练☆48Updated 8 months ago
- The huggingface implementation of Fine-grained Late-interaction Multi-modal Retriever.☆88Updated last week
- Repo for "VRAG-RL: Empower Vision-Perception-Based RAG for Visually Rich Information Understanding via Iterative Reasoning with Reinforce…☆20Updated this week
- 主要记录大语言大模型（LLMs） 算法（应用）工程师多模态相关知识☆198Updated last year
- 视觉信息抽取任务中，使用OCR识别结果规范多模态大模型的回答☆34Updated 5 months ago
- Multimodal Open-O1 (MO1) is designed to enhance the accuracy of inference models by utilizing a novel prompt-based approach. This tool wo…☆29Updated 8 months ago
- Official PyTorch Implementation of MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced …☆78Updated 6 months ago
- ☆28Updated last year
- ☆60Updated 2 weeks ago
- ☆85Updated last year
- ☆29Updated 9 months ago
- Towards Efficient and Effective Text-to-Video Retrieval with Coarse-to-Fine Visual Representation Learning☆16Updated 3 months ago
- Exploring Efficient Fine-Grained Perception of Multimodal Large Language Models☆60Updated 7 months ago
- LLM Tokenizer with BPE algorithm☆31Updated last year
- 【ArXiv】PDF-Wukong: A Large Multimodal Model for Efficient Long PDF Reading with End-to-End Sparse Sampling☆117Updated 7 months ago