PKU-YuanGroup / LLaVA-CoT

Related projects ⓘ

Alternatives and complementary repositories for LLaVA-CoT

• deepseek-ai / Janus
  Janus-Series: Unified Multimodal Understanding and Generation Models
  ☆1,084Updated last week
• baaivision / Emu3
  Next-Token Prediction is All You Need
  ☆1,832Updated 3 weeks ago
• GAIR-NLP / anole
  Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation
  ☆677Updated 3 months ago
• AIDC-AI / Ovis
  A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.
  ☆534Updated 2 weeks ago
• rhymes-ai / Aria
  Codebase for Aria - an Open Multimodal Native MoE
  ☆843Updated this week
• Open-Source-O1 / Open-O1
  ☆837Updated this week
• SimpleBerry / LLaMA-O1
  Large Reasoning Models
  ☆612Updated this week
• facebookresearch / chameleon
  Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.
  ☆1,841Updated 3 months ago
• DAMO-NLP-SG / VideoLLaMA2
  VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs
  ☆890Updated this week
• NVlabs / VILA
  VILA - a multi-image visual language model with training, inference and evaluation recipe, deployable from cloud to edge (Jetson Orin and…
  ☆2,004Updated 3 weeks ago
• BAAI-DCAI / Bunny
  A family of lightweight multimodal models.
  ☆933Updated this week
• LLaVA-VL / LLaVA-NeXT
  ☆2,920Updated last month
• gokayfem / awesome-vlm-architectures
  Famous Vision Language Models and Their Architectures
  ☆433Updated 2 months ago
• QwenLM / Qwen2-VL
  Qwen2-VL is the multimodal large language model series developed by Qwen team, Alibaba Cloud.
  ☆3,199Updated last month
• mbzuai-oryx / LLaVA-pp
  🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)
  ☆813Updated 4 months ago
• Vision-CAIR / MiniGPT4-video
  Official code for Goldfish model for long video understanding and MiniGPT4-video for short video understanding
  ☆559Updated last month
• X-PLUG / mPLUG-DocOwl
  mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding
  ☆1,603Updated last month
• open-compass / VLMEvalKit
  Open-source evaluation toolkit of large vision-language models (LVLMs), support 160+ VLMs, 50+ benchmarks
  ☆1,382Updated this week
• apple / ml-4m
  4M: Massively Multimodal Masked Modeling
  ☆1,608Updated last month
• THUDM / CogVLM2
  GPT4V-level open-source multi-modal model based on Llama3-8B
  ☆2,127Updated 2 months ago
• PKU-YuanGroup / MoE-LLaVA
  Mixture-of-Experts for Large Vision-Language Models
  ☆1,994Updated 6 months ago
• OpenBMB / VisRAG
  Parsing-free RAG supported by VLMs
  ☆405Updated this week
• microsoft / LLM2CLIP
  LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.
  ☆275Updated this week
• LLaVA-VL / LLaVA-Plus-Codebase
  LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills
  ☆708Updated 9 months ago
• cambrian-mllm / cambrian
  Cambrian-1 is a family of multimodal LLMs with a vision-centric design.
  ☆1,767Updated 3 weeks ago
• adithya-s-k / VARAG
  Vision-Augmented Retrieval and Generation (VARAG) - Vision first RAG Engine
  ☆359Updated last month
• tencent-ailab / persona-hub
  Official repo for the paper "Scaling Synthetic Data Creation with 1,000,000,000 Personas"
  ☆891Updated last month
• VITA-MLLM / VITA
  ✨✨VITA: Towards Open-Source Interactive Omni Multimodal LLM
  ☆968Updated 3 weeks ago
• TinyLLaVA / TinyLLaVA_Factory
  A Framework of Small-scale Large Multimodal Models
  ☆656Updated this week