Alternatives and similar repositories for CogVLM

Users that are interested in CogVLM are comparing it to the libraries listed below

• QwenLM / Qwen-VL
  The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.
  ☆6,511Updated last year
• zai-org / CogVLM2
  GPT4V-level open-source multi-modal model based on Llama3-8B
  ☆2,429Updated 11 months ago
• OpenGVLab / InternVL
  [CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型
  ☆9,759Updated 4 months ago
• InternLM / InternLM-XComposer
  InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions
  ☆2,923Updated 8 months ago
• haotian-liu / LLaVA
  [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
  ☆24,402Updated last year
• LLaVA-VL / LLaVA-NeXT
  ☆4,539Updated 4 months ago
• InternLM / xtuner
  A Next-Generation Training Engine Built for Ultra-Large MoE Models
  ☆5,067Updated this week
• DAMO-NLP-SG / Video-LLaMA
  [EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
  ☆3,119Updated last year
• X-PLUG / mPLUG-Owl
  mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
  ☆2,540Updated 10 months ago
• PKU-YuanGroup / Video-LLaVA
  【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection
  ☆3,445Updated last year
• PKU-YuanGroup / MoE-LLaVA
  【TMM 2025🔥】 Mixture-of-Experts for Large Vision-Language Models
  ☆2,299Updated 6 months ago
• NExT-GPT / NExT-GPT
  Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model
  ☆3,616Updated 8 months ago
• salesforce / LAVIS
  LAVIS - A One-stop Library for Language-Vision Intelligence
  ☆11,138Updated last year
• mlfoundations / open_flamingo
  An open-source framework for training large multimodal models.
  ☆4,067Updated last year
• InternLM / InternLM
  Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).
  ☆7,149Updated 3 months ago
• OpenGVLab / LLaMA-Adapter
  [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters
  ☆5,936Updated last year
• OpenGVLab / Ask-Anything
  [CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.
  ☆3,334Updated last year
• Alpha-VLLM / LLaMA2-Accessory
  An Open-source Toolkit for LLM Development
  ☆2,803Updated last year
• InternLM / lmdeploy
  LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
  ☆7,560Updated last week
• xinyu1205 / recognize-anything
  Open-source and strong foundation image recognition models.
  ☆3,578Updated 11 months ago
• baaivision / Emu
  Emu Series: Generative Multimodal Models from BAAI
  ☆1,763Updated 3 weeks ago
• facebookresearch / ImageBind
  ImageBind One Embedding Space to Bind Them All
  ☆8,956Updated 2 months ago
• salesforce / BLIP
  PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
  ☆5,658Updated last year
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,830Updated last year
• huggingface / peft
  🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
  ☆20,543Updated last week
• JIA-Lab-research / MGM
  Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"
  ☆3,333Updated last year
• X-PLUG / mPLUG-DocOwl
  mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding
  ☆2,368Updated 8 months ago
• JIA-Lab-research / LongLoRA
  Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)
  ☆2,699Updated last year
• open-mmlab / Multimodal-GPT
  Multimodal-GPT
  ☆1,518Updated 2 years ago
• NVlabs / VILA
  VILA is a family of state-of-the-art vision language models (VLMs) for diverse multimodal AI tasks across the edge, data center, and clou…
  ☆3,734Updated 2 months ago