Alternatives and similar repositories for VILA:

Users that are interested in VILA are comparing it to the libraries listed below

• LLaVA-VL / LLaVA-NeXT
  ☆3,316Updated 3 months ago
• facebookresearch / chameleon
  Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.
  ☆1,913Updated 5 months ago
• cambrian-mllm / cambrian
  Cambrian-1 is a family of multimodal LLMs with a vision-centric design.
  ☆1,831Updated 2 months ago
• deepseek-ai / DeepSeek-VL
  DeepSeek-VL: Towards Real-World Vision-Language Understanding
  ☆2,556Updated 9 months ago
• PKU-YuanGroup / MoE-LLaVA
  Mixture-of-Experts for Large Vision-Language Models
  ☆2,058Updated last month
• baaivision / Emu3
  Next-Token Prediction is All You Need
  ☆1,976Updated 3 months ago
• THUDM / CogVLM2
  GPT4V-level open-source multi-modal model based on Llama3-8B
  ☆2,228Updated 4 months ago
• apple / ml-4m
  4M: Massively Multimodal Masked Modeling
  ☆1,671Updated 3 months ago
• dvlab-research / MGM
  Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"
  ☆3,236Updated 8 months ago
• lichao-sun / Mora
  Mora: More like Sora for Generalist Video Generation
  ☆1,543Updated 3 months ago
• QwenLM / Qwen2-VL
  Qwen2-VL is the multimodal large language model series developed by Qwen team, Alibaba Cloud.
  ☆4,328Updated this week
• OpenGVLab / InternVL
  [CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型
  ☆6,880Updated last month
• PKU-YuanGroup / Video-LLaVA
  【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection
  ☆3,124Updated last month
• InternLM / InternLM-XComposer
  InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions
  ☆2,731Updated last week
• facebookresearch / jepa
  PyTorch code and models for V-JEPA self-supervised learning from video.
  ☆2,747Updated 5 months ago
• open-compass / VLMEvalKit
  Open-source evaluation toolkit of large vision-language models (LVLMs), support 160+ VLMs, 50+ benchmarks
  ☆1,735Updated this week
• apple / ml-aim
  This repository provides the code and model checkpoints for AIMv1 and AIMv2 research projects.
  ☆1,157Updated 2 months ago
• AIDC-AI / Ovis
  A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.
  ☆599Updated 2 months ago
• rhymes-ai / Aria
  Codebase for Aria - an Open Multimodal Native MoE
  ☆978Updated last week
• NVIDIA / Cosmos-Tokenizer
  A suite of image and video neural tokenizers
  ☆1,524Updated last week
• DAMO-NLP-SG / VideoLLaMA2
  VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs
  ☆1,040Updated this week
• mini-sora / minisora
  MiniSora: A community aims to explore the implementation path and future development direction of Sora.
  ☆1,250Updated last month
• NUS-HPC-AI-Lab / VideoSys
  VideoSys: An easy and efficient system for video generation
  ☆1,891Updated 3 weeks ago
• baaivision / Emu
  Emu Series: Generative Multimodal Models from BAAI
  ☆1,675Updated 4 months ago
• PKU-YuanGroup / LLaVA-CoT
  LLaVA-CoT, a visual language model capable of spontaneous, systematic reasoning
  ☆1,768Updated last week
• deepseek-ai / DeepSeek-VL2
  DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding
  ☆1,005Updated last week
• InternLM / xtuner
  An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
  ☆4,178Updated last week
• IDEA-Research / Grounding-DINO-1.5-API
  Grounding DINO 1.5: IDEA Research's Most Capable Open-World Object Detection Model Series
  ☆864Updated last week
• FoundationVision / LlamaGen
  Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation
  ☆1,466Updated 5 months ago
• MiniMax-AI / MiniMax-01
  ☆1,973Updated last week