Alternatives and similar repositories for LLaVA-CoT

Users that are interested in LLaVA-CoT are comparing it to the libraries listed below

• AIDC-AI / Ovis
  A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.
  ☆1,321Updated 3 weeks ago
• StarsfieldAI / R1-V
  Witness the aha moment of VLM with less than $3.
  ☆3,929Updated 3 months ago
• LLaVA-VL / LLaVA-NeXT
  ☆4,202Updated last week
• open-compass / VLMEvalKit
  Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
  ☆3,030Updated this week
• baaivision / Emu3
  Next-Token Prediction is All You Need
  ☆2,192Updated 5 months ago
• EvolvingLMMs-Lab / open-r1-multimodal
  A fork to add multimodal model training to open-r1
  ☆1,387Updated 7 months ago
• 2U1 / Qwen2-VL-Finetune
  An open-source implementaion for fine-tuning Qwen2-VL and Qwen2.5-VL series by Alibaba Cloud.
  ☆1,125Updated last week
• gokayfem / awesome-vlm-architectures
  Famous Vision Language Models and Their Architectures
  ☆1,004Updated 6 months ago
• cambrian-mllm / cambrian
  Cambrian-1 is a family of multimodal LLMs with a vision-centric design.
  ☆1,945Updated 10 months ago
• DAMO-NLP-SG / VideoLLaMA2
  VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs
  ☆1,217Updated 7 months ago
• TinyLLaVA / TinyLLaVA_Factory
  A Framework of Small-scale Large Multimodal Models
  ☆893Updated 4 months ago
• MoonshotAI / Kimi-VL
  Kimi-VL: Mixture-of-Experts Vision-Language Model for Multimodal Reasoning, Long-Context Understanding, and Strong Agent Capabilities
  ☆1,053Updated last month
• rhymes-ai / Aria
  Codebase for Aria - an Open Multimodal Native MoE
  ☆1,067Updated 7 months ago
• BAAI-DCAI / Bunny
  A family of lightweight multimodal models.
  ☆1,039Updated 9 months ago
• VITA-MLLM / VITA
  ✨✨VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction
  ☆2,401Updated 5 months ago
• AIDC-AI / Marco-o1
  An Open Large Reasoning Model for Real-World Solutions
  ☆1,515Updated 3 months ago
• Open-Source-O1 / Open-O1
  ☆1,355Updated 9 months ago
• ByteDance-Seed / Seed1.5-VL
  Seed1.5-VL, a vision-language foundation model designed to advance general-purpose multimodal understanding and reasoning, achieving stat…
  ☆1,416Updated 2 months ago
• zhangfaen / finetune-Qwen2-VL
  ☆368Updated 7 months ago
• DAMO-NLP-SG / VideoLLaMA3
  Frontier Multimodal Foundation Models for Image and Video Understanding
  ☆970Updated 3 weeks ago
• InternLM / InternLM-XComposer
  InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions
  ☆2,891Updated 3 months ago
• zai-org / CogVLM2
  GPT4V-level open-source multi-modal model based on Llama3-8B
  ☆2,413Updated 6 months ago
• GAIR-NLP / anole
  Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation
  ☆798Updated 2 months ago
• facebookresearch / chameleon
  Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.
  ☆2,050Updated last year
• zai-org / GLM-V
  GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning
  ☆1,599Updated 2 weeks ago
• NVlabs / VILA
  VILA is a family of state-of-the-art vision language models (VLMs) for diverse multimodal AI tasks across the edge, data center, and clou…
  ☆3,528Updated last month
• X-PLUG / mPLUG-DocOwl
  mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding
  ☆2,246Updated 3 months ago
• ML-GSAI / LLaDA
  Official PyTorch implementation for "Large Language Diffusion Models"
  ☆2,864Updated this week
• NVlabs / describe-anything
  [ICCV 2025] Implementation for Describe Anything: Detailed Localized Image and Video Captioning
  ☆1,323Updated 2 months ago
• PKU-YuanGroup / MoE-LLaVA
  【TMM 2025🔥】 Mixture-of-Experts for Large Vision-Language Models
  ☆2,231Updated last month