Alternatives and similar repositories for LLaVA

Users that are interested in LLaVA are comparing it to the libraries listed below

• zai-org / CogVLM
  a state-of-the-art-level open visual language model | 多模态预训练模型
  ☆6,712Updated last year
• QwenLM / Qwen-VL
  The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.
  ☆6,453Updated last year
• salesforce / LAVIS
  LAVIS - A One-stop Library for Language-Vision Intelligence
  ☆11,102Updated last year
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,805Updated last year
• microsoft / LoRA
  Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
  ☆13,106Updated last year
• huggingface / peft
  🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
  ☆20,382Updated 2 weeks ago
• OpenGVLab / InternVL
  [CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型
  ☆9,659Updated 3 months ago
• lm-sys / FastChat
  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
  ☆39,346Updated 7 months ago
• mlfoundations / open_clip
  An open source implementation of CLIP.
  ☆13,178Updated 2 months ago
• OpenGVLab / LLaMA-Adapter
  [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters
  ☆5,932Updated last year
• mlfoundations / open_flamingo
  An open-source framework for training large multimodal models.
  ☆4,056Updated last year
• Vision-CAIR / MiniGPT-4
  Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)
  ☆25,769Updated last year
• Dao-AILab / flash-attention
  Fast and memory-efficient exact attention
  ☆21,401Updated this week
• huggingface / trl
  Train transformer language models with reinforcement learning.
  ☆16,844Updated this week
• salesforce / BLIP
  PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
  ☆5,626Updated last year
• tloen / alpaca-lora
  Instruct-tune LLaMA on consumer hardware
  ☆18,986Updated last year
• LLaVA-VL / LLaVA-NeXT
  ☆4,474Updated 3 months ago
• meta-llama / llama3
  The official Meta Llama 3 GitHub site
  ☆29,156Updated 11 months ago
• meta-llama / llama
  Inference code for Llama models
  ☆59,014Updated 11 months ago
• mit-han-lab / streaming-llm
  [ICLR 2024] Efficient Streaming Language Models with Attention Sinks
  ☆7,164Updated last year
• facebookresearch / ImageBind
  ImageBind One Embedding Space to Bind Them All
  ☆8,926Updated last month
• facebookresearch / dinov2
  PyTorch code and models for the DINOv2 self-supervised learning method.
  ☆12,166Updated last week
• microsoft / unilm
  Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
  ☆21,920Updated 3 weeks ago
• meta-llama / llama-cookbook
  Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We als…
  ☆18,136Updated 2 months ago
• PKU-YuanGroup / Video-LLaVA
  【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection
  ☆3,427Updated last year
• NExT-GPT / NExT-GPT
  Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model
  ☆3,603Updated 7 months ago
• BradyFU / Awesome-Multimodal-Large-Language-Models
  Latest Advances on Multimodal Large Language Models
  ☆17,098Updated last week
• vllm-project / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆66,734Updated this week
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆10,716Updated 2 weeks ago
• BlinkDL / RWKV-LM
  RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable)…
  ☆14,263Updated 2 weeks ago