Alternatives and similar repositories for LLaVA

Users that are interested in LLaVA are comparing it to the libraries listed below

• salesforce / LAVIS
  LAVIS - A One-stop Library for Language-Vision Intelligence
  ☆10,870Updated 9 months ago
• zai-org / CogVLM
  a state-of-the-art-level open visual language model | 多模态预训练模型
  ☆6,658Updated last year
• huggingface / peft
  🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
  ☆19,498Updated this week
• microsoft / LoRA
  Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
  ☆12,627Updated 8 months ago
• QwenLM / Qwen-VL
  The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.
  ☆6,209Updated last year
• salesforce / BLIP
  PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
  ☆5,462Updated last year
• lm-sys / FastChat
  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
  ☆39,070Updated 3 months ago
• BradyFU / Awesome-Multimodal-Large-Language-Models
  Latest Advances on Multimodal Large Language Models
  ☆16,182Updated this week
• huggingface / trl
  Train transformer language models with reinforcement learning.
  ☆15,409Updated this week
• facebookresearch / ImageBind
  ImageBind One Embedding Space to Bind Them All
  ☆8,779Updated last year
• OpenGVLab / LLaMA-Adapter
  [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters
  ☆5,893Updated last year
• vllm-project / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆57,435Updated this week
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,648Updated last year
• mlfoundations / open_flamingo
  An open-source framework for training large multimodal models.
  ☆4,004Updated last year
• Dao-AILab / flash-attention
  Fast and memory-efficient exact attention
  ☆19,385Updated this week
• mlfoundations / open_clip
  An open source implementation of CLIP.
  ☆12,513Updated last month
• IDEA-Research / Grounded-Segment-Anything
  Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and …
  ☆16,874Updated last year
• tloen / alpaca-lora
  Instruct-tune LLaMA on consumer hardware
  ☆18,956Updated last year
• hiyouga / LLaMA-Factory
  Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
  ☆57,209Updated this week
• LLaVA-VL / LLaVA-NeXT
  ☆4,172Updated this week
• BlinkDL / RWKV-LM
  RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable)…
  ☆13,950Updated last week
• OpenGVLab / InternVL
  [CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型
  ☆9,002Updated this week
• microsoft / unilm
  Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
  ☆21,702Updated 2 months ago
• facebookresearch / dinov2
  PyTorch code and models for the DINOv2 self-supervised learning method.
  ☆11,501Updated 3 weeks ago
• IDEA-Research / GroundingDINO
  [ECCV 2024] Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"
  ☆8,818Updated last year
• nlpxucan / WizardLM
  LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
  ☆9,457Updated 3 months ago
• Vision-CAIR / MiniGPT-4
  Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)
  ☆25,738Updated last year
• QwenLM / Qwen2.5-VL
  Qwen2.5-VL is the multimodal large language model series developed by Qwen team, Alibaba Cloud.
  ☆12,383Updated 3 months ago
• tatsu-lab / stanford_alpaca
  Code and documentation to train Stanford's Alpaca models, and generate the data.
  ☆30,141Updated last year
• PKU-YuanGroup / Video-LLaVA
  【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection
  ☆3,348Updated 9 months ago