Alternatives and similar repositories for vila-u

Users that are interested in vila-u are comparing it to the libraries listed below

• NVlabs / Long-RL
  Long-RL: Scaling RL to Long Sequences (NeurIPS 2025)
  ☆625Updated last week
• facebookresearch / metamorph
  Code for MetaMorph Multimodal Understanding and Generation via Instruction Tuning
  ☆212Updated 5 months ago
• ByteVisionLab / TokenFlow
  [CVPR 2025] 🔥 Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".
  ☆384Updated last month
• FoundationVision / UniTok
  [NeurIPS 2025 Spotlight] A Unified Tokenizer for Visual Generation and Understanding
  ☆408Updated last week
• wdrink / SimpleAR
  Pytorch implementation for the paper titled "SimpleAR: Pushing the Frontier of Autoregressive Visual Generation"
  ☆407Updated 3 months ago
• CodeGoat24 / UnifiedReward
  Official implementation of UnifiedReward & [NeurIPS 2025] UnifiedReward-Think
  ☆555Updated last week
• rongyaofang / GoT
  Official repository of "GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing"
  ☆289Updated this week
• baaivision / EVE
  EVE Series: Encoder-Free Vision-Language Models from BAAI
  ☆352Updated 2 months ago
• selftok-team / SelftokTokenizer
  Selftok: Discrete Visual Tokens of Autoregression, by Diffusion, and for Reasoning
  ☆217Updated 4 months ago
• ML-GSAI / LLaDA-V
  ☆228Updated last week
• lxa9867 / Awesome-Autoregressive-Visual-Generation
  This is a repo to track the latest autoregressive visual generation papers.
  ☆399Updated 3 months ago
• rongyaofang / PUMA
  Empowering Unified MLLM with Multi-granular Visual Generation
  ☆130Updated 8 months ago
• rese1f / aurora
  [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark
  ☆128Updated 3 months ago
• Yxxxb / VoCo-LLaMA
  [CVPR'2025] VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".
  ☆189Updated 3 months ago
• baaivision / DIVA
  [ICLR 2025] Diffusion Feedback Helps CLIP See Better
  ☆288Updated 8 months ago
• baaivision / NOVA
  [ICLR 2025] Autoregressive Video Generation without Vector Quantization
  ☆575Updated 3 weeks ago
• OpenGVLab / VideoChat-R1
  [NIPS2025] VideoChat-R1 & R1.5: Enhancing Spatio-Temporal Perception and Reasoning via Reinforcement Fine-Tuning
  ☆204Updated this week
• facebookresearch / webssl
  Code for "Scaling Language-Free Visual Representation Learning" paper (Web-SSL).
  ☆185Updated 5 months ago
• rccchoudhury / rlt
  Official Implementation for our NeurIPS 2024 paper, "Don't Look Twice: Run-Length Tokenization for Faster Video Transformers".
  ☆224Updated 6 months ago
• facebookresearch / metaquery
  Official Implementation of Paper Transfer between Modalities with MetaQueries
  ☆240Updated 2 months ago
• Haochen-Wang409 / ross
  [ICLR'25] Reconstructive Visual Instruction Tuning
  ☆118Updated 5 months ago
• RunpeiDong / DreamLLM
  [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation
  ☆459Updated 10 months ago
• LMM101 / Awesome-Multimodal-Next-Token-Prediction
  [Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey
  ☆449Updated 8 months ago
• dvlab-research / VisionZip
  Official repository for VisionZip (CVPR 2025)
  ☆352Updated 2 months ago
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆393Updated 6 months ago
• ziqipang / RandAR
  [CVPR 2025 (Oral)] Open implementation of "RandAR"
  ☆196Updated 2 months ago
• PKU-YuanGroup / WISE
  WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generation
  ☆151Updated this week
• NJU-PCALab / OpenVid-1M
  [ICLR 2025] OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generation
  ☆343Updated 4 months ago
• TIGER-AI-Lab / Pixel-Reasoner
  Pixel-Level Reasoning Model trained with RL [NeuIPS25]
  ☆216Updated 3 weeks ago
• stepfun-ai / NextStep-1
  ☆546Updated last week