Alternatives and similar repositories for vila-u:

Users that are interested in vila-u are comparing it to the libraries listed below

• facebookresearch / metamorph
  Code for MetaMorph Multimodal Understanding and Generation via Instruction Tuning
  ☆156Updated 2 weeks ago
• rongyaofang / GoT
  Official repository of "GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing"
  ☆236Updated last week
• baaivision / EVE
  EVE Series: Encoder-Free Vision-Language Models from BAAI
  ☆324Updated 2 months ago
• ByteFlow-AI / TokenFlow
  [CVPR 2025] 🔥 Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".
  ☆318Updated 2 months ago
• wdrink / SimpleAR
  Pytorch implementation for the paper titled "SimpleAR: Pushing the Frontier of Autoregressive Visual Generation"
  ☆333Updated 2 weeks ago
• baaivision / NOVA
  [ICLR 2025] Autoregressive Video Generation without Vector Quantization
  ☆492Updated 2 weeks ago
• RunpeiDong / DreamLLM
  [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation
  ☆438Updated 5 months ago
• FoundationVision / UniTok
  A Unified Tokenizer for Visual Generation and Understanding
  ☆270Updated 3 weeks ago
• LMM101 / Awesome-Multimodal-Next-Token-Prediction
  [Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey
  ☆422Updated 3 months ago
• invictus717 / MiCo
  Explore the Limits of Omni-modal Pretraining at Scale
  ☆97Updated 8 months ago
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆374Updated last month
• NJU-PCALab / OpenVid-1M
  [ICLR 2025] OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generation
  ☆288Updated 2 months ago
• lxa9867 / Awesome-Autoregressive-Visual-Generation
  This is a repo to track the latest autoregressive visual generation papers.
  ☆300Updated this week
• CodeGoat24 / UnifiedReward
  Official implementation of Unified Reward Model for Multimodal Understanding and Generation.
  ☆243Updated this week
• bronyayang / Law_of_Vision_Representation_in_MLLMs
  Official implementation of the Law of Vision Representation in MLLMs
  ☆154Updated 5 months ago
• AdaCache-DiT / AdaCache
  Adaptive Caching for Faster Video Generation with Diffusion Transformers
  ☆147Updated 6 months ago
• rongyaofang / PUMA
  Empowering Unified MLLM with Multi-granular Visual Generation
  ☆119Updated 3 months ago
• YuqingWang1029 / PAR
  [CVPR2025 Highlight] PAR: Parallelized Autoregressive Visual Generation. https://yuqingwang1029.github.io/PAR-project
  ☆151Updated last month
• feizc / DiT-MoE
  Scaling Diffusion Transformers with Mixture of Experts
  ☆317Updated 7 months ago
• tulerfeng / Video-R1
  Video-R1: Reinforcing Video Reasoning in MLLMs [🔥the first paper to explore R1 for video]
  ☆489Updated last week
• vision-x-nyu / thinking-in-space
  Official repo and evaluation implementation of VSI-Bench
  ☆475Updated 2 months ago
• End2End-Diffusion / REPA-E
  Official implementation of the paper: REPA-E: Unlocking VAE for End-to-End Tuning of Latent Diffusion Transformers
  ☆190Updated 3 weeks ago
• lxa9867 / ImageFolder
  High-performance Image Tokenizers for VAR and AR
  ☆255Updated last week
• ShareGPT4Omni / ShareGPT4V
  [ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions
  ☆218Updated 10 months ago
• FreedomIntelligence / LongLLaVA
  LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
  ☆201Updated 4 months ago
• baaivision / DIVA
  [ICLR 2025] Diffusion Feedback Helps CLIP See Better
  ☆277Updated 3 months ago
• rccchoudhury / rlt
  Official Implementation for our NeurIPS 2024 paper, "Don't Look Twice: Run-Length Tokenization for Faster Video Transformers".
  ☆210Updated last month
• dongyh20 / Insight-V
  [CVPR2025 Highlight] Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models
  ☆188Updated last month
• Yxxxb / VoCo-LLaMA
  [CVPR'2025] VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".
  ☆155Updated 2 months ago
• PKU-YuanGroup / Video-Bench
  A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!
  ☆125Updated last year