Alternatives and similar repositories for LLaVA

Users that are interested in LLaVA are comparing it to the libraries listed below

• zai-org / CogVLM
  a state-of-the-art-level open visual language model | 多模态预训练模型
  ☆6,705Updated last year
• lm-sys / FastChat
  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
  ☆39,287Updated 6 months ago
• microsoft / LoRA
  Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
  ☆13,010Updated 11 months ago
• BradyFU / Awesome-Multimodal-Large-Language-Models
  Latest Advances on Multimodal Large Language Models
  ☆16,847Updated this week
• huggingface / peft
  🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
  ☆20,157Updated 2 weeks ago
• QwenLM / Qwen-VL
  The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.
  ☆6,409Updated last year
• salesforce / LAVIS
  LAVIS - A One-stop Library for Language-Vision Intelligence
  ☆11,047Updated last year
• facebookresearch / ImageBind
  ImageBind One Embedding Space to Bind Them All
  ☆8,880Updated 2 weeks ago
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,778Updated last year
• mlfoundations / open_flamingo
  An open-source framework for training large multimodal models.
  ☆4,049Updated last year
• meta-llama / llama
  Inference code for Llama models
  ☆58,968Updated 10 months ago
• OpenGVLab / LLaMA-Adapter
  [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters
  ☆5,924Updated last year
• tatsu-lab / stanford_alpaca
  Code and documentation to train Stanford's Alpaca models, and generate the data.
  ☆30,236Updated last year
• mlc-ai / mlc-llm
  Universal LLM Deployment Engine with ML Compilation
  ☆21,691Updated last week
• OpenGVLab / InternVL
  [CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型
  ☆9,551Updated 2 months ago
• meta-llama / llama-cookbook
  Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We als…
  ☆18,061Updated last month
• huggingface / trl
  Train transformer language models with reinforcement learning.
  ☆16,473Updated last week
• Dao-AILab / flash-attention
  Fast and memory-efficient exact attention
  ☆20,804Updated last week
• tloen / alpaca-lora
  Instruct-tune LLaMA on consumer hardware
  ☆18,983Updated last year
• LLaVA-VL / LLaVA-NeXT
  ☆4,429Updated 2 months ago
• PKU-YuanGroup / Video-LLaVA
  【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection
  ☆3,405Updated last year
• unslothai / unsloth
  Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek-R1, Qwen3, Gemma 3, TTS 2x faster with 70% less VRAM.
  ☆48,786Updated last week
• NExT-GPT / NExT-GPT
  Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model
  ☆3,596Updated 6 months ago
• nlpxucan / WizardLM
  LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
  ☆9,469Updated 5 months ago
• hpcaitech / ColossalAI
  Making large AI models cheaper, faster and more accessible
  ☆41,272Updated last week
• mit-han-lab / streaming-llm
  [ICLR 2024] Efficient Streaming Language Models with Attention Sinks
  ☆7,135Updated last year
• facebookresearch / segment-anything
  The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoi…
  ☆52,710Updated last year
• salesforce / BLIP
  PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
  ☆5,594Updated last year
• vllm-project / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆64,235Updated this week
• hpcaitech / Open-Sora
  Open-Sora: Democratizing Efficient Video Production for All
  ☆28,040Updated 7 months ago