Alternatives and similar repositories for CogVLM:

Users that are interested in CogVLM are comparing it to the libraries listed below

• QwenLM / Qwen-VL
  The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.
  ☆5,470Updated 6 months ago
• haotian-liu / LLaVA
  [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
  ☆21,480Updated 6 months ago
• Dao-AILab / flash-attention
  Fast and memory-efficient exact attention
  ☆15,541Updated this week
• InternLM / lmdeploy
  LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
  ☆5,603Updated this week
• OpenGVLab / InternVL
  [CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型
  ☆7,059Updated last month
• LLaVA-VL / LLaVA-NeXT
  ☆3,423Updated last week
• THUDM / CogVLM2
  GPT4V-level open-source multi-modal model based on Llama3-8B
  ☆2,262Updated 5 months ago
• huggingface / trl
  Train transformer language models with reinforcement learning.
  ☆11,782Updated this week
• huggingface / peft
  🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
  ☆17,363Updated this week
• salesforce / LAVIS
  LAVIS - A One-stop Library for Language-Vision Intelligence
  ☆10,253Updated 3 months ago
• PKU-YuanGroup / Video-LLaVA
  【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection
  ☆3,153Updated 2 months ago
• InternLM / InternLM-XComposer
  InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions
  ☆2,755Updated 3 weeks ago
• mit-han-lab / streaming-llm
  [ICLR 2024] Efficient Streaming Language Models with Attention Sinks
  ☆6,795Updated 7 months ago
• mlfoundations / open_flamingo
  An open-source framework for training large multimodal models.
  ☆3,823Updated 5 months ago
• NExT-GPT / NExT-GPT
  Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model
  ☆3,423Updated 3 months ago
• InternLM / xtuner
  An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
  ☆4,246Updated 3 weeks ago
• sgl-project / sglang
  SGLang is a fast serving framework for large language models and vision language models.
  ☆10,325Updated this week
• DAMO-NLP-SG / Video-LLaMA
  [EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
  ☆2,920Updated 8 months ago
• FlagOpen / FlagEmbedding
  Retrieval and Retrieval-augmented LLMs
  ☆8,555Updated last week
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,250Updated 8 months ago
• PKU-YuanGroup / MoE-LLaVA
  Mixture-of-Experts for Large Vision-Language Models
  ☆2,082Updated 2 months ago
• BradyFU / Awesome-Multimodal-Large-Language-Models
  Latest Advances on Multimodal Large Language Models
  ☆13,909Updated last week
• modelscope / ms-swift
  Use PEFT or Full-parameter to finetune 450+ LLMs (Qwen2.5, InternLM3, GLM4, Llama3.3, Mistral, Yi1.5, Baichuan2, DeepSeek-R1, ...) and 15…
  ☆5,674Updated this week
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆9,777Updated this week
• microsoft / LoRA
  Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
  ☆11,325Updated 2 months ago
• bitsandbytes-foundation / bitsandbytes
  Accessible large language models via k-bit quantization for PyTorch.
  ☆6,697Updated this week
• LargeWorldModel / LWM
  Large World Model -- Modeling Text and Video with Millions Context
  ☆7,226Updated 4 months ago
• jzhang38 / TinyLlama
  The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
  ☆8,220Updated 9 months ago
• Alpha-VLLM / LLaMA2-Accessory
  An Open-source Toolkit for LLM Development
  ☆2,758Updated last month
• AutoGPTQ / AutoGPTQ
  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
  ☆4,702Updated 3 weeks ago