Alternatives and similar repositories for VLM-learning

Users that are interested in VLM-learning are comparing it to the libraries listed below

• zhangfaen / finetune-InternVL2
  ☆24Updated 9 months ago
• xinyanghuang7 / Basic-Visual-Language-Model
  Build a simple basic multimodal large model from scratch. 从零搭建一个简单的基础多模态大模型🤖
  ☆38Updated 10 months ago
• AI-Study-Han / Zero-Qwen-VL
  训练一个对中文支持更好的LLaVA模型，并开源训练代码和数据。
  ☆56Updated 8 months ago
• jinbo0906 / Awesome-MLLM-Datasets
  This project aims to collect and collate various datasets for multimodal large model training, including but not limited to pre-training …
  ☆43Updated last week
• yujunhuics / Reyes
  从零到一实现了一个多模态大模型，并命名为Reyes（睿视），R：睿，eyes：眼。Reyes的参数量为8B，视觉编码器使用的是InternViT-300M-448px-V2_5,语言模型侧使用的是Qwen2.5-7B-Instruct，Reyes也通过一个两层MLP投影层连…
  ☆13Updated 3 months ago
• BIGBALLON / GME-Search
  A multimodal image search engine built on the GME model, capable of handling diverse input types. Whether you're querying with text, imag…
  ☆35Updated 4 months ago
• bzluan / TextCoT
  The official repo for “TextCoT: Zoom In for Enhanced Multimodal Text-Rich Image Understanding”.
  ☆39Updated 7 months ago
• alipay / Ant-Multi-Modal-Framework
  Research Code for Multimodal-Cognition Team in Ant Group
  ☆143Updated 10 months ago
• Token-family / TokenFD
  A Token-level Text Image Foundation Model for Document Understanding
  ☆91Updated 2 weeks ago
• OvJat / DeepSpeedTutorial
  DeepSpeed Tutorial
  ☆97Updated 9 months ago
• liujunwen23 / MIRE
  WWW2025 Multimodal Intent Recognition for Dialogue Systems Challenge
  ☆120Updated 6 months ago
• xiteng01 / CVPR2023_foundation_model_Track1
  Workshop on Foundation Model 1st foundation model challenge Track1 codebase (Open TransMind v1.0)
  ☆18Updated 2 years ago
• owenliang / qwen-dpo
  通义千问的DPO训练
  ☆47Updated 7 months ago
• yuyq96 / TextHawk
  Exploring Efficient Fine-Grained Perception of Multimodal Large Language Models
  ☆60Updated 6 months ago
• ding523 / Curr_REFT
  ☆56Updated last month
• xmu-xiaoma666 / Multimodal-Open-O1
  Multimodal Open-O1 (MO1) is designed to enhance the accuracy of inference models by utilizing a novel prompt-based approach. This tool wo…
  ☆29Updated 7 months ago
• PanguIR / MRAGSurvey
  A Survey of Multimodal Retrieval-Augmented Generation
  ☆18Updated 3 weeks ago
• LDLINGLINGLING / adan_application
  一些大语言模型和多模态模型的应用,主要包括小模型，Agent，跨模态搜索，OCR、RAG、ChatBot等等
  ☆170Updated this week
• VectorSpaceLab / MegaPairs
  MegaPairs: Massive Data Synthesis For Universal Multimodal Retrieval
  ☆167Updated this week
• yh-hust / PDF-Wukong
  【ArXiv】PDF-Wukong: A Large Multimodal Model for Efficient Long PDF Reading with End-to-End Sparse Sampling
  ☆116Updated 6 months ago
• sandy1990418 / Finetune-Qwen2.5-VL
  Fine-tuning Qwen2.5-VL for vision-language tasks | Optimized for Vision understanding | LoRA & PEFT support.
  ☆64Updated 3 months ago
• deepglint / UniME
  The official code of "Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs"
  ☆61Updated last week
• aJupyter / ThinkLLM
  ThinkLLM：🚀 轻量、高效的大语言模型算法实现
  ☆53Updated this week
• MonolithFoundation / Bumblebee
  A Simple MLLM Surpassed QwenVL-Max with OpenSource Data Only in 14B LLM.
  ☆37Updated 8 months ago
• jiahe7ay / llm_learning
  这是个人关于llm的学习归纳，把我学到的知识分享给大家，让大家也能系统和简单学习llm理论及应用实战
  ☆8Updated 11 months ago
• reilxlx / llava-Qwen2-7B-Instruct-Chinese-CLIP
  模型 llava-Qwen2-7B-Instruct-Chinese-CLIP 增强中文文字识别能力和表情包内涵识别能力，接近gpt4o、claude-3.5-sonnet的识别水平！
  ☆22Updated 9 months ago
• Ucas-HaoranWei / Vary-family
  ☆56Updated last year
• taishan1994 / llava-handbook
  对llava官方代码的一些学习笔记
  ☆24Updated 7 months ago
• bobo0810 / LearnDeepSpeed
  DeepSpeed教程 & 示例注释 & 学习笔记 （大模型高效训练）
  ☆162Updated last year
• cnzzx / VSA
  Vision Search Assistant: Empower Vision-Language Models as Multimodal Search Engines
  ☆125Updated 6 months ago