Alternatives and similar repositories for nanoLLaVA

Users that are interested in nanoLLaVA are comparing it to the libraries listed below

• XiaoduoAILab / XmodelVLM
  ☆69Updated last year
• SHI-Labs / OLA-VLM
  OLA-VLM: Elevating Visual Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024
  ☆60Updated 6 months ago
• mbzuai-oryx / PALO
  (WACV 2025 - Oral) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, H…
  ☆83Updated 3 weeks ago
• fangyuan-ksgk / Mini-LLaVA
  A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.
  ☆95Updated 8 months ago
• PKU-YuanGroup / LLaVA-o1
  ☆56Updated 9 months ago
• neulab / Pangea
  This is the repo for the paper "PANGEA: A FULLY OPEN MULTILINGUAL MULTIMODAL LLM FOR 39 LANGUAGES"
  ☆110Updated 2 months ago
• adithya-s-k / YoloGemma
  Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…
  ☆83Updated last year
• vis-nlp / ChartGemma
  ☆67Updated last year
• neulab / MultiUI
  Code for Paper: Harnessing Webpage Uis For Text Rich Visual Understanding
  ☆53Updated 8 months ago
• mmhamdy / open-language-models
  A list of language models with permissive licenses such as MIT or Apache 2.0
  ☆24Updated 5 months ago
• EPFL-VILAB / fm-vision-evals
  ☆69Updated last month
• ritabratamaiti / AnyModal
  AnyModal is a Flexible Multimodal Language Model Framework for PyTorch
  ☆102Updated 8 months ago
• ShadeAlsha / ICon
  ICLR 2025 - official implementation for "I-Con: A Unifying Framework for Representation Learning"
  ☆111Updated 2 months ago
• CERC-AAI / Robin
  ☆63Updated 11 months ago
• AviSoori1x / seemore
  From scratch implementation of a vision language model in pure PyTorch
  ☆235Updated last year
• CogNLP / CogAGENT
  ☆35Updated 2 years ago
• mfarre / Video-LLaVA-7B-hf-CinePile
  Video-LlaVA fine-tune for CinePile evaluation
  ☆51Updated last year
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆131Updated 2 months ago
• nahidalam / maya
  Maya: An Instruction Finetuned Multilingual Multimodal Model using Aya
  ☆117Updated 3 weeks ago
• ariG23498 / mmdp
  ☆27Updated last month
• huggingface / screensuite
  ScreenSuite - The most comprehensive benchmarking suite for GUI Agents!
  ☆105Updated 3 weeks ago
• BorealisAI / neuzip
  Official repository for the paper "NeuZip: Memory-Efficient Training and Inference with Dynamic Compression of Neural Networks". This rep…
  ☆59Updated 9 months ago
• apple / ml-mofi
  ☆59Updated last year
• anguyen8 / vision-llms-are-blind
  ☆133Updated last year
• yihedeng9 / OpenVLThinker
  OpenVLThinker: An Early Exploration to Vision-Language Reasoning via Iterative Self-Improvement
  ☆107Updated last month
• XiaoduoAILab / XmodelLM
  XmodelLM
  ☆39Updated 9 months ago
• GenRobo / MatMamba
  Code and pretrained models for the paper: "MatMamba: A Matryoshka State Space Model"
  ☆61Updated 9 months ago
• agents-x-project / PyVision
  Official implementation of "PyVision: Agentic Vision with Dynamic Tooling."
  ☆120Updated last month
• du-nlp-lab / MLR-Copilot
  ☆66Updated 4 months ago
• agokrani / distillKitPlus
  Easy to use, High Performant Knowledge Distillation for LLMs
  ☆92Updated 3 months ago