WatchTower-Liu / VLM-learning
Building a VLM model starts from the basic module.
☆13Updated 11 months ago
Alternatives and similar repositories for VLM-learning:
Users that are interested in VLM-learning are comparing it to the libraries listed below
- ☆21Updated 7 months ago
- 训练一个对中文支持更好的LLaVA模型,并开源训练代码和数据。☆53Updated 6 months ago
- Build a simple basic multimodal large model from scratch. 从零搭建一个简单的基础多模态大模型🤖☆34Updated 9 months ago
- Multimodal Open-O1 (MO1) is designed to enhance the accuracy of inference models by utilizing a novel prompt-based approach. This tool wo…☆29Updated 5 months ago
- ☆56Updated last year
- 一些大语言模型和多模态模型的应用,主要包括Rag,小模型,Agent,跨模态搜索,OCR等等☆157Updated 4 months ago
- Research Code for Multimodal-Cognition Team in Ant Group☆137Updated 8 months ago
- 本项目使用LLaVA 1.6多模态模型实现以文搜图和以图搜图功能。☆20Updated last year
- Train InternViT-6B in MMSegmentation and MMDetection with DeepSpeed☆82Updated 4 months ago
- 视觉信息抽取任务中,使用OCR识别结果规范多模态大模型的回答☆27Updated 2 months ago
- The official repo for “TextCoT: Zoom In for Enhanced Multimodal Text-Rich Image Understanding”.☆38Updated 6 months ago
- Exploring Efficient Fine-Grained Perception of Multimodal Large Language Models☆60Updated 4 months ago
- Our 2nd-gen LMM☆33Updated 10 months ago
- WWW2025 Multimodal Intent Recognition for Dialogue Systems Challenge☆118Updated 4 months ago
- Workshop on Foundation Model 1st foundation model challenge Track1 codebase (Open TransMind v1.0)☆18Updated last year
- ☆27Updated 10 months ago
- ☆29Updated 7 months ago
- Music large model based on InternLM2-chat.☆22Updated 3 months ago
- 八戒-Chat是利用《西游记》剧本中所有关于猪八戒的台词和语句,以及Chat-GPT-3.5生成的相关问题结果,基于Internlm进行QLoRA微调得到的模仿猪八戒语气的聊天语言模型。☆23Updated 7 months ago
- Vision Search Assistant: Empower Vision-Language Models as Multimodal Search Engines☆117Updated 4 months ago
- A Simple MLLM Surpassed QwenVL-Max with OpenSource Data Only in 14B LLM.☆37Updated 6 months ago
- 模型 llava-Qwen2-7B-Instruct-Chinese-CLIP 增强中文文字识别能力和表情包内涵识别能力,接近gpt4o、claude-3.5-sonnet的识别水平!☆22Updated 8 months ago
- ATEC2023——赛道一: 大模型的知识引入Rank7方案分享☆21Updated 4 months ago
- Precision Search through Multi-Style Inputs☆65Updated 7 months ago
- GroundVLP: Harnessing Zero-shot Visual Grounding from Vision-Language Pre-training and Open-Vocabulary Object Detection (AAAI 2024)☆64Updated last year
- ☆80Updated 10 months ago
- Evaluation code and datasets for the ACL 2024 paper, VISTA: Visualized Text Embedding for Universal Multi-Modal Retrieval. The original c…☆35Updated 4 months ago