Alternatives and similar repositories for NaViT:

Users that are interested in NaViT are comparing it to the libraries listed below

• Meituan-AutoML / VisionLLaMA
  VisionLLaMA: A Unified LLaMA Backbone for Vision Tasks
  ☆376Updated 6 months ago
• baaivision / CapsFusion
  [CVPR 2024] CapsFusion: Rethinking Image-Text Data at Scale
  ☆201Updated 11 months ago
• mit-han-lab / vila-u
  [ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation
  ☆212Updated last week
• Beckschen / ViTamin
  [CVPR 2024] Official implementation of "ViTamin: Designing Scalable Vision Models in the Vision-language Era"
  ☆196Updated 7 months ago
• baaivision / EVE
  [NeurIPS'24 Spotlight] EVE: Encoder-Free Vision-Language Models
  ☆268Updated 3 months ago
• ByteFlow-AI / TokenFlow
  🔥 Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".
  ☆234Updated last month
• x-cls / superclass
  [NeurIPS 2024] Classification Done Right for Vision-Language Pre-Training
  ☆197Updated 2 weeks ago
• mutonix / Vript
  ☆133Updated 2 weeks ago
• feizc / DiT-MoE
  Scaling Diffusion Transformers with Mixture of Experts
  ☆245Updated 4 months ago
• ai-forever / MoVQGAN
  MoVQGAN - model for the image encoding and reconstruction
  ☆215Updated last year
• DAMO-NLP-SG / Inf-CLIP
  The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for Contrastive Loss". A su…
  ☆220Updated 2 weeks ago
• X2FD / LVIS-INSTRUCT4V
  ☆132Updated last year
• RERV / VDT
  [ICLR2024] The official implementation of paper "VDT: General-purpose Video Diffusion Transformers via Mask Modeling", by Haoyu Lu, Guoxi…
  ☆226Updated 8 months ago
• alibaba / conv-llava
  ☆109Updated 6 months ago
• JourneyDB / JourneyDB
  ☆163Updated last year
• bfshi / scaling_on_scales
  When do we not need larger vision models?
  ☆357Updated last month
• baaivision / DenseFusion
  DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception
  ☆130Updated last month
• scenarios / WeMM
  ☆85Updated 6 months ago
• jy0205 / LaVIT
  LaVIT: Empower the Large Language Model to Understand and Generate Visual Content
  ☆553Updated 3 months ago
• snap-research / Panda-70M
  [CVPR 2024] Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers
  ☆563Updated 3 months ago
• FreedomIntelligence / ALLaVA
  Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model
  ☆252Updated 7 months ago
• bronyayang / Law_of_Vision_Representation_in_MLLMs
  Official implementation of the Law of Vision Representation in MLLMs
  ☆148Updated 2 months ago
• baaivision / DIVA
  [ICLR 2025] Diffusion Feedback Helps CLIP See Better
  ☆247Updated last week
• invictus717 / MiCo
  Explore the Limits of Omni-modal Pretraining at Scale
  ☆96Updated 4 months ago
• whlzy / FiT
  [ICML 2024 Spotlight] FiT: Flexible Vision Transformer for Diffusion Model
  ☆395Updated 2 months ago
• 42Shawn / LLaVA-PruMerge
  LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models
  ☆113Updated 8 months ago
• YuchenLiu98 / COMM
  Pytorch code for paper From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language Models
  ☆192Updated 3 weeks ago
• BAAI-DCAI / Visual-Instruction-Tuning
  SVIT: Scaling up Visual Instruction Tuning
  ☆164Updated 7 months ago
• ShareGPT4Omni / ShareGPT4V
  [ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions
  ☆191Updated 6 months ago
• naver-ai / rope-vit
  [ECCV 2024] Official PyTorch implementation of RoPE-ViT "Rotary Position Embedding for Vision Transformer"
  ☆270Updated last month