Alternatives and similar repositories for CogVLM

Users that are interested in CogVLM are comparing it to the libraries listed below

• QwenLM / Qwen-VL
  The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.
  ☆6,151Updated last year
• InternLM / InternLM-XComposer
  InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions
  ☆2,878Updated 2 months ago
• zai-org / CogVLM2
  GPT4V-level open-source multi-modal model based on Llama3-8B
  ☆2,404Updated 5 months ago
• haotian-liu / LLaVA
  [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
  ☆23,180Updated 11 months ago
• PKU-YuanGroup / Video-LLaVA
  【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection
  ☆3,320Updated 8 months ago
• PKU-YuanGroup / MoE-LLaVA
  【TMM 2025🔥】 Mixture-of-Experts for Large Vision-Language Models
  ☆2,205Updated 3 weeks ago
• NExT-GPT / NExT-GPT
  Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model
  ☆3,541Updated 2 months ago
• DAMO-NLP-SG / Video-LLaMA
  [EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
  ☆3,045Updated last year
• X-PLUG / mPLUG-Owl
  mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
  ☆2,506Updated 4 months ago
• InternLM / xtuner
  An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
  ☆4,671Updated 3 weeks ago
• Alpha-VLLM / LLaMA2-Accessory
  An Open-source Toolkit for LLM Development
  ☆2,787Updated 6 months ago
• LLaVA-VL / LLaVA-NeXT
  ☆4,080Updated last month
• OpenGVLab / LLaMA-Adapter
  [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters
  ☆5,888Updated last year
• mlfoundations / open_flamingo
  An open-source framework for training large multimodal models.
  ☆3,986Updated 11 months ago
• OpenGVLab / InternVL
  [CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型
  ☆8,700Updated 3 weeks ago
• dvlab-research / MGM
  Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"
  ☆3,301Updated last year
• OpenGVLab / Ask-Anything
  [CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.
  ☆3,284Updated 6 months ago
• xinyu1205 / recognize-anything
  Open-source and strong foundation image recognition models.
  ☆3,364Updated 5 months ago
• baaivision / Emu
  Emu Series: Generative Multimodal Models from BAAI
  ☆1,739Updated 10 months ago
• InternLM / InternLM
  Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).
  ☆7,013Updated last week
• salesforce / LAVIS
  LAVIS - A One-stop Library for Language-Vision Intelligence
  ☆10,797Updated 8 months ago
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,593Updated last year
• facebookresearch / ImageBind
  ImageBind One Embedding Space to Bind Them All
  ☆8,741Updated last year
• dvlab-research / LongLoRA
  Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)
  ☆2,676Updated 11 months ago
• mit-han-lab / streaming-llm
  [ICLR 2024] Efficient Streaming Language Models with Attention Sinks
  ☆6,949Updated last year
• FlagOpen / FlagEmbedding
  Retrieval and Retrieval-augmented LLMs
  ☆10,262Updated 3 weeks ago
• microsoft / LoRA
  Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
  ☆12,477Updated 7 months ago
• salesforce / BLIP
  PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
  ☆5,421Updated last year
• huggingface / peft
  🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
  ☆19,184Updated this week
• IDEA-Research / GroundingDINO
  [ECCV 2024] Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"
  ☆8,594Updated 11 months ago