Alternatives and similar repositories for vila-u

Users that are interested in vila-u are comparing it to the libraries listed below

• NVlabs / Long-RL
  Long-RL: Scaling RL to Long Sequences
  ☆584Updated last week
• facebookresearch / metamorph
  Code for MetaMorph Multimodal Understanding and Generation via Instruction Tuning
  ☆207Updated 4 months ago
• ByteVisionLab / TokenFlow
  [CVPR 2025] 🔥 Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".
  ☆371Updated 2 weeks ago
• CodeGoat24 / UnifiedReward
  Official implementation of UnifiedReward & UnifiedReward-Think
  ☆511Updated 3 weeks ago
• FoundationVision / UniTok
  A Unified Tokenizer for Visual Generation and Understanding
  ☆388Updated 3 weeks ago
• rongyaofang / GoT
  Official repository of "GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing"
  ☆276Updated 3 months ago
• baaivision / EVE
  EVE Series: Encoder-Free Vision-Language Models from BAAI
  ☆345Updated last month
• wdrink / SimpleAR
  Pytorch implementation for the paper titled "SimpleAR: Pushing the Frontier of Autoregressive Visual Generation"
  ☆397Updated 2 months ago
• rongyaofang / PUMA
  Empowering Unified MLLM with Multi-granular Visual Generation
  ☆130Updated 7 months ago
• selftok-team / SelftokTokenizer
  Selftok: Discrete Visual Tokens of Autoregression, by Diffusion, and for Reasoning
  ☆206Updated 2 months ago
• lxa9867 / Awesome-Autoregressive-Visual-Generation
  This is a repo to track the latest autoregressive visual generation papers.
  ☆389Updated last month
• ML-GSAI / LLaDA-V
  ☆208Updated last week
• rese1f / aurora
  [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark
  ☆122Updated 2 months ago
• baaivision / NOVA
  [ICLR 2025] Autoregressive Video Generation without Vector Quantization
  ☆562Updated 2 weeks ago
• baaivision / DIVA
  [ICLR 2025] Diffusion Feedback Helps CLIP See Better
  ☆286Updated 7 months ago
• Purshow / Awesome-Unified-Multimodal
  📖 This is a repository for organizing papers, codes, and other resources related to unified multimodal models.
  ☆276Updated last week
• rccchoudhury / rlt
  Official Implementation for our NeurIPS 2024 paper, "Don't Look Twice: Run-Length Tokenization for Faster Video Transformers".
  ☆223Updated 4 months ago
• RunpeiDong / DreamLLM
  [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation
  ☆454Updated 8 months ago
• Yxxxb / VoCo-LLaMA
  [CVPR'2025] VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".
  ☆184Updated 2 months ago
• hywang66 / LARP
  Official Pytorch implementation for LARP: Tokenizing Videos with a Learned Autoregressive Generative Prior (ICLR 2025 Oral).
  ☆88Updated 6 months ago
• Haochen-Wang409 / ross
  [ICLR'25] Reconstructive Visual Instruction Tuning
  ☆103Updated 4 months ago
• LMM101 / Awesome-Multimodal-Next-Token-Prediction
  [Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey
  ☆447Updated 7 months ago
• dvlab-research / VisionZip
  Official repository for VisionZip (CVPR 2025)
  ☆337Updated last month
• PKU-YuanGroup / WISE
  WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generation
  ☆143Updated last week
• causalfusion / causalfusion
  ☆177Updated 8 months ago
• tulerfeng / Video-R1
  Video-R1: Reinforcing Video Reasoning in MLLMs [🔥the first paper to explore R1 for video]
  ☆667Updated 3 weeks ago
• bronyayang / Law_of_Vision_Representation_in_MLLMs
  Official implementation of the Law of Vision Representation in MLLMs
  ☆163Updated 9 months ago
• ziqipang / RandAR
  [CVPR 2025 (Oral)] Open implementation of "RandAR"
  ☆188Updated last month
• facebookresearch / webssl
  Code for "Scaling Language-Free Visual Representation Learning" paper (Web-SSL).
  ☆174Updated 3 months ago
• lxa9867 / ImageFolder
  High-performance Image Tokenizers for VAR and AR
  ☆279Updated 3 months ago