Alternatives and similar repositories for VLM-learning

Users that are interested in VLM-learning are comparing it to the libraries listed below

• zhangfaen / finetune-InternVL2
  ☆30Updated last year
• BIGBALLON / UME-Search
  Toward Universal Multimodal Embedding
  ☆55Updated 3 weeks ago
• xinyanghuang7 / Basic-Visual-Language-Model
  Build a simple basic multimodal large model from scratch. 从零搭建一个简单的基础多模态大模型🤖
  ☆45Updated last year
• AI-Study-Han / Zero-Qwen-VL
  训练一个对中文支持更好的LLaVA模型，并开源训练代码和数据。
  ☆68Updated 11 months ago
• alipay / Ant-Multi-Modal-Framework
  Research Code for Multimodal-Cognition Team in Ant Group
  ☆163Updated last month
• LDLINGLINGLING / adan_application
  一些大语言模型和多模态模型的生态,主要包括跨模态搜索、投机解码、QAT量化、多模态量化、ChatBot、OCR
  ☆188Updated 2 weeks ago
• yujunhuics / Reyes
  从零到一实现了一个多模态大模型，并命名为Reyes（睿视），R：睿，eyes：眼。Reyes的参数量为8B，视觉编码器使用的是InternViT-300M-448px-V2_5,语言模型侧使用的是Qwen2.5-7B-Instruct，Reyes也通过一个两层MLP投影层连…
  ☆25Updated 6 months ago
• VectorSpaceLab / MegaPairs
  [ACL 2025 Oral] 🔥🔥 MegaPairs: Massive Data Synthesis for Universal Multimodal Retrieval
  ☆219Updated 3 months ago
• deepglint / UniME
  [ACM MM25] The official code of "Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs"
  ☆85Updated 3 weeks ago
• yh-hust / PDF-Wukong
  【ArXiv】PDF-Wukong: A Large Multimodal Model for Efficient Long PDF Reading with End-to-End Sparse Sampling
  ☆122Updated 2 months ago
• jinbo0906 / Awesome-MLLM-Datasets
  This project aims to collect and collate various datasets for multimodal large model training, including but not limited to pre-training …
  ☆55Updated 3 months ago
• liujunwen23 / MIRE
  WWW2025 Multimodal Intent Recognition for Dialogue Systems Challenge
  ☆124Updated 9 months ago
• hhaAndroid / awesome-mm-chat
  多模态 MM +Chat 合集
  ☆275Updated last week
• opendatalab / VIGC
  AAAI 2024: Visual Instruction Generation and Correction
  ☆93Updated last year
• yuanpinz / awesome-deep-multimodal-reasoning
  Collect the awesome works evolved around reasoning models like O1/R1 in visual domain
  ☆41Updated last month
• wdndev / mllm_interview_note
  主要记录大语言大模型（LLMs） 算法（应用）工程师多模态相关知识
  ☆230Updated last year
• ShaohonChen / Qwen3-SmVL
  将SmolVLM2的视觉头与Qwen3-0.6B模型进行了拼接微调
  ☆277Updated 3 weeks ago
• JiuTian-VL / JiuTian-LION
  [CVPR 2024] LION: Empowering Multimodal Large Language Model with Dual-Level Visual Knowledge
  ☆150Updated last year
• 360CVGroup / FG-CLIP
  New generation of CLIP with fine grained discrimination capability, ICML2025
  ☆277Updated last month
• BUAADreamer / MLLM-Finetuning-Demo
  使用LLaMA-Factory微调多模态大语言模型的示例代码 Demo of Finetuning Multimodal LLM with LLaMA-Factory
  ☆49Updated 11 months ago
• Ucas-HaoranWei / Vary-family
  ☆57Updated last year
• xiteng01 / CVPR2023_foundation_model_Track1
  Workshop on Foundation Model 1st foundation model challenge Track1 codebase (Open TransMind v1.0)
  ☆18Updated 2 years ago
• reilxlx / llava-Qwen2-7B-Instruct-Chinese-CLIP
  模型 llava-Qwen2-7B-Instruct-Chinese-CLIP 增强中文文字识别能力和表情包内涵识别能力，接近gpt4o、claude-3.5-sonnet的识别水平！
  ☆24Updated last year
• LinWeizheDragon / FLMR
  The huggingface implementation of Fine-grained Late-interaction Multi-modal Retriever.
  ☆96Updated 2 months ago
• OpenGVLab / InternVL-MMDetSeg
  Train InternViT-6B in MMSegmentation and MMDetection with DeepSpeed
  ☆97Updated 10 months ago
• bzluan / TextCoT
  The official repo for “TextCoT: Zoom In for Enhanced Multimodal Text-Rich Image Understanding”.
  ☆41Updated 11 months ago
• NExT-ChatV / NExT-Chat
  The code of the paper "NExT-Chat: An LMM for Chat, Detection and Segmentation".
  ☆249Updated last year
• JimmyMa99 / BaJie-Chat
  八戒-Chat是利用《西游记》剧本中所有关于猪八戒的台词和语句，以及Chat-GPT-3.5生成的相关问题结果，基于Internlm进行QLoRA微调得到的模仿猪八戒语气的聊天语言模型。
  ☆23Updated 3 weeks ago
• shufangxun / LLaVA-MoD
  [ICLR 2025] LLaVA-MoD: Making LLaVA Tiny via MoE-Knowledge Distillation
  ☆192Updated 4 months ago
• PanguIR / MRAGSurvey
  A Survey of Multimodal Retrieval-Augmented Generation
  ☆18Updated 4 months ago