Alternatives and similar repositories for Mini-LLaVA:

Users that are interested in Mini-LLaVA are comparing it to the libraries listed below

• facebookresearch / unibench
  Python Library to evaluate VLM models' robustness across diverse benchmarks
  ☆181Updated 3 weeks ago
• iancovert / locality-alignment
  ☆40Updated this week
• stanfordmlgroup / ManyICL
  ☆131Updated 7 months ago
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆68Updated this week
• FreedomIntelligence / LongLLaVA
  LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
  ☆188Updated last week
• EvolvingLMMs-Lab / multimodal-sae
  Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.
  ☆97Updated 2 weeks ago
• SHI-Labs / OLA-VLM
  OLA-VLM: Elevating Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024
  ☆45Updated last month
• TempleX98 / MoVA
  [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context
  ☆140Updated 3 months ago
• huggingface / picotron_tutorial
  ☆104Updated last week
• GaiZhenbiao / Phi3V-Finetuning
  Parameter-efficient finetuning script for Phi-3-vision, the strong multimodal language model by Microsoft.
  ☆56Updated 7 months ago
• kaiyuyue / nxtp
  Object Recognition as Next Token Prediction (CVPR 2024 Highlight)
  ☆169Updated 3 weeks ago
• kirill-vish / Beyond-INet
  Code for experiments for "ConvNet vs Transformer, Supervised vs CLIP: Beyond ImageNet Accuracy"
  ☆100Updated 4 months ago
• IDEA-Research / ChatRex
  Code for ChatRex: Taming Multimodal LLM for Joint Perception and Understanding
  ☆122Updated last month
• MILVLG / imp
  a family of highly capabale yet efficient large multimodal models
  ☆176Updated 4 months ago
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆189Updated 8 months ago
• mbzuai-oryx / PALO
  (WACV 2025) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, Hindi, B…
  ☆81Updated 4 months ago
• kyegomez / PALI3
  Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
  ☆143Updated 2 months ago
• XiaoduoAILab / XmodelVLM
  ☆65Updated 6 months ago
• DAMO-NLP-SG / multimodal_textbook
  The official repository for "2.5 Years in Class: A Multimodal Textbook for Vision-Language Pretraining"
  ☆117Updated last week
• kongds / E5-V
  E5-V: Universal Embeddings with Multimodal Large Language Models
  ☆215Updated 3 weeks ago
• TIGER-AI-Lab / VLM2Vec
  This repo contains the code and data for "VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks"
  ☆109Updated 2 weeks ago
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆50Updated 4 months ago
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆90Updated last month
• hu-po / streamdocs
  Documentation, notes, links, etc for streams.
  ☆76Updated 11 months ago
• neulab / MultiUI
  Code for Paper: Harnessing Webpage Uis For Text Rich Visual Understanding
  ☆44Updated last month
• kyegomez / Mixture-of-Depths
  Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆78Updated this week
• ByungKwanLee / TroL
  [EMNLP 2024] Official PyTorch implementation code for realizing the technical part of Traversal of Layers (TroL) presenting new propagati…
  ☆90Updated 6 months ago
• apple / ml-mofi
  ☆58Updated 10 months ago
• MBZUAI-LLM / web2code
  Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs
  ☆70Updated 2 months ago