Alternatives and similar repositories for llava-phi:

Users that are interested in llava-phi are comparing it to the libraries listed below

• FoundationVision / Groma
  [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization
  ☆531Updated 7 months ago
• xiaoachen98 / Open-LLaVA-NeXT
  An open-source implementation for training LLaVA-NeXT.
  ☆375Updated 3 months ago
• Oryx-mllm / Oryx
  MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution
  ☆279Updated last month
• NVlabs / EAGLE
  Eagle Family: Exploring Model Designs, Data Recipes and Training Strategies for Frontier-Class Multimodal LLMs
  ☆552Updated this week
• thunlp / LLaVA-UHD
  LLaVA-UHD v2: an MLLM Integrating High-Resolution Feature Pyramid via Hierarchical Window Transformer
  ☆354Updated 2 weeks ago
• DCDmllm / Cheetah
  ☆345Updated 8 months ago
• CircleRadon / TokenPacker
  The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".
  ☆233Updated last month
• WisconsinAIVision / ViP-LLaVA
  [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts
  ☆308Updated 6 months ago
• ZrrSkywalker / MathVerse
  [ECCV 2024] Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?
  ☆151Updated 4 months ago
• LLaVA-VL / LLaVA-Plus-Codebase
  LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills
  ☆721Updated 11 months ago
• JiuhaiChen / Florence-VL
  ☆215Updated last month
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆359Updated 2 months ago
• mlpc-ucsd / BLIVA
  (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions
  ☆251Updated 9 months ago
• luogen1996 / LLaVA-HR
  LLaVA-HR: High-Resolution Large Language-Vision Assistant
  ☆223Updated 5 months ago
• OpenGVLab / all-seeing
  [ICLR 2024 & ECCV 2024] The All-Seeing Projects: Towards Panoptic Visual Recognition&Understanding and General Relation Comprehension of …
  ☆473Updated 5 months ago
• Meituan-AutoML / VisionLLaMA
  VisionLLaMA: A Unified LLaMA Backbone for Vision Tasks
  ☆376Updated 6 months ago
• RunpeiDong / DreamLLM
  [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation
  ☆410Updated last month
• AILab-CVC / SEED-Bench
  (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
  ☆326Updated 2 weeks ago
• mbzuai-oryx / LlamaV-o1
  Rethinking Step-by-step Visual Reasoning in LLMs
  ☆218Updated this week
• FreedomIntelligence / ALLaVA
  Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model
  ☆252Updated 7 months ago
• MILVLG / imp
  a family of highly capabale yet efficient large multimodal models
  ☆176Updated 5 months ago
• pkunlp-icler / FastV
  [ECCV 2024 Oral] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Langua…
  ☆347Updated 3 weeks ago
• microsoft / LLM2CLIP
  LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.
  ☆452Updated last week
• OpenGVLab / MM-Interleaved
  MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer
  ☆210Updated 9 months ago
• FoundationVision / OmniTokenizer
  [NeurIPS 2024]OmniTokenizer: one model and one weight for image-video joint tokenization.
  ☆271Updated 6 months ago
• dongyh20 / Insight-V
  Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models
  ☆127Updated last month
• bfshi / scaling_on_scales
  When do we not need larger vision models?
  ☆357Updated last month
• allenai / unified-io-2
  ☆591Updated 11 months ago
• yuweihao / MM-Vet
  MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)
  ☆282Updated last week
• OpenGVLab / LAMM
  [NeurIPS 2023 Datasets and Benchmarks Track] LAMM: Multi-Modal Large Language Models and Applications as AI Agents
  ☆306Updated 9 months ago