Alternatives and similar repositories for CogVLM

Users that are interested in CogVLM are comparing it to the libraries listed below

• QwenLM / Qwen-VL
  The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.
  ☆5,896Updated 9 months ago
• haotian-liu / LLaVA
  [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
  ☆22,540Updated 9 months ago
• THUDM / CogVLM2
  GPT4V-level open-source multi-modal model based on Llama3-8B
  ☆2,349Updated 2 months ago
• InternLM / InternLM
  Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).
  ☆6,907Updated 3 months ago
• OpenGVLab / LLaMA-Adapter
  [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters
  ☆5,873Updated last year
• Instruction-Tuning-with-GPT-4 / GPT-4-LLM
  Instruction Tuning with GPT-4
  ☆4,303Updated last year
• PKU-YuanGroup / Video-LLaVA
  【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection
  ☆3,240Updated 5 months ago
• OpenGVLab / InternVL
  [CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型
  ☆8,132Updated 3 weeks ago
• NExT-GPT / NExT-GPT
  Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model
  ☆3,499Updated last week
• InternLM / xtuner
  An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
  ☆4,547Updated 2 weeks ago
• X-PLUG / mPLUG-Owl
  mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
  ☆2,479Updated last month
• mlfoundations / open_flamingo
  An open-source framework for training large multimodal models.
  ☆3,921Updated 8 months ago
• LLaVA-VL / LLaVA-NeXT
  ☆3,837Updated 2 weeks ago
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,430Updated 11 months ago
• DAMO-NLP-SG / Video-LLaMA
  [EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
  ☆3,002Updated 11 months ago
• OpenBMB / ToolBench
  [ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.
  ☆5,031Updated 6 months ago
• Alpha-VLLM / LLaMA2-Accessory
  An Open-source Toolkit for LLM Development
  ☆2,780Updated 4 months ago
• PKU-YuanGroup / MoE-LLaVA
  Mixture-of-Experts for Large Vision-Language Models
  ☆2,158Updated 5 months ago
• InternLM / lmdeploy
  LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
  ☆6,357Updated this week
• huggingface / peft
  🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
  ☆18,433Updated this week
• dvlab-research / LongLoRA
  Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)
  ☆2,659Updated 9 months ago
• InternLM / InternLM-XComposer
  InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions
  ☆2,833Updated 3 weeks ago
• mit-han-lab / streaming-llm
  [ICLR 2024] Efficient Streaming Language Models with Attention Sinks
  ☆6,886Updated 10 months ago
• BradyFU / Awesome-Multimodal-Large-Language-Models
  Latest Advances on Multimodal Large Language Models
  ☆15,184Updated last week
• AutoGPTQ / AutoGPTQ
  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
  ☆4,846Updated last month
• salesforce / LAVIS
  LAVIS - A One-stop Library for Language-Vision Intelligence
  ☆10,558Updated 6 months ago
• bitsandbytes-foundation / bitsandbytes
  Accessible large language models via k-bit quantization for PyTorch.
  ☆7,043Updated this week
• microsoft / LoRA
  Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
  ☆11,954Updated 5 months ago
• OpenGVLab / Ask-Anything
  [CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.
  ☆3,239Updated 4 months ago
• facebookresearch / ImageBind
  ImageBind One Embedding Space to Bind Them All
  ☆8,646Updated 9 months ago