Alternatives and similar repositories for CogVLM:

Users that are interested in CogVLM are comparing it to the libraries listed below

• QwenLM / Qwen-VL
  The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.
  ☆5,842Updated 8 months ago
• haotian-liu / LLaVA
  [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
  ☆22,354Updated 8 months ago
• salesforce / LAVIS
  LAVIS - A One-stop Library for Language-Vision Intelligence
  ☆10,516Updated 5 months ago
• mlfoundations / open_flamingo
  An open-source framework for training large multimodal models.
  ☆3,904Updated 8 months ago
• InternLM / InternLM-XComposer
  InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions
  ☆2,820Updated last week
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,411Updated 10 months ago
• InternLM / lmdeploy
  LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
  ☆6,274Updated this week
• THUDM / CogVLM2
  GPT4V-level open-source multi-modal model based on Llama3-8B
  ☆2,341Updated 2 months ago
• InternLM / xtuner
  An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
  ☆4,520Updated 3 weeks ago
• NExT-GPT / NExT-GPT
  Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model
  ☆3,492Updated 6 months ago
• huggingface / peft
  🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
  ☆18,274Updated this week
• InternLM / InternLM
  Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).
  ☆6,889Updated 2 months ago
• OpenGVLab / InternVL
  [CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型
  ☆7,966Updated last week
• PKU-YuanGroup / Video-LLaVA
  【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection
  ☆3,238Updated 5 months ago
• open-compass / opencompass
  OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, …
  ☆5,279Updated this week
• microsoft / LoRA
  Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
  ☆11,847Updated 4 months ago
• Alpha-VLLM / LLaMA2-Accessory
  An Open-source Toolkit for LLM Development
  ☆2,774Updated 3 months ago
• facebookresearch / ImageBind
  ImageBind One Embedding Space to Bind Them All
  ☆8,627Updated 9 months ago
• AutoGPTQ / AutoGPTQ
  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
  ☆4,826Updated 3 weeks ago
• OpenGVLab / LLaMA-Adapter
  [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters
  ☆5,868Updated last year
• LLaVA-VL / LLaVA-NeXT
  ☆3,763Updated 2 months ago
• salesforce / BLIP
  PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
  ☆5,212Updated 9 months ago
• DAMO-NLP-SG / Video-LLaMA
  [EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
  ☆2,998Updated 11 months ago
• FlagOpen / FlagEmbedding
  Retrieval and Retrieval-augmented LLMs
  ☆9,524Updated 3 weeks ago
• huggingface / trl
  Train transformer language models with reinforcement learning.
  ☆13,559Updated this week
• BradyFU / Awesome-Multimodal-Large-Language-Models
  Latest Advances on Multimodal Large Language Models
  ☆14,909Updated last week
• PKU-YuanGroup / MoE-LLaVA
  Mixture-of-Experts for Large Vision-Language Models
  ☆2,152Updated 5 months ago
• allenai / OLMo
  Modeling, training, eval, and inference code for OLMo
  ☆5,560Updated this week
• X-PLUG / mPLUG-Owl
  mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
  ☆2,468Updated last month
• bitsandbytes-foundation / bitsandbytes
  Accessible large language models via k-bit quantization for PyTorch.
  ☆6,972Updated this week