Alternatives and similar repositories for vila-u:

Users that are interested in vila-u are comparing it to the libraries listed below

• ByteFlow-AI / TokenFlow
  [CVPR 2025] 🔥 Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".
  ☆307Updated last month
• baaivision / EVE
  EVE Series: Encoder-Free Vision-Language Models from BAAI
  ☆320Updated last month
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆371Updated 3 weeks ago
• FoundationVision / UniTok
  A Unified Tokenizer for Visual Generation and Understanding
  ☆249Updated this week
• baaivision / NOVA
  [ICLR 2025] Autoregressive Video Generation without Vector Quantization
  ☆466Updated 2 weeks ago
• bronyayang / Law_of_Vision_Representation_in_MLLMs
  Official implementation of the Law of Vision Representation in MLLMs
  ☆153Updated 4 months ago
• rongyaofang / GoT
  Official repository of "GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing"
  ☆214Updated 3 weeks ago
• Yxxxb / VoCo-LLaMA
  [CVPR'2025] VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".
  ☆151Updated last month
• tulerfeng / Video-R1
  Video-R1: Reinforcing Video Reasoning in MLLMs [🔥the first paper to explore R1 for video]
  ☆391Updated this week
• CodeGoat24 / UnifiedReward
  Official implementation of Unified Reward Model for Multimodal Understanding and Generation.
  ☆238Updated this week
• Purshow / Awesome-Unified-Multimodal
  📖 This is a repository for organizing papers, codes, and other resources related to unified multimodal models.
  ☆171Updated last week
• lxa9867 / Awesome-Autoregressive-Visual-Generation
  This is a repo to track the latest autoregressive visual generation papers.
  ☆246Updated this week
• FreedomIntelligence / LongLLaVA
  LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
  ☆201Updated 3 months ago
• YuqingWang1029 / PAR
  [CVPR2025 Highlight] PAR: Parallelized Autoregressive Visual Generation. https://yuqingwang1029.github.io/PAR-project
  ☆146Updated 3 weeks ago
• 42Shawn / LLaVA-PruMerge
  LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models
  ☆124Updated 11 months ago
• vision-x-nyu / thinking-in-space
  Official repo and evaluation implementation of VSI-Bench
  ☆449Updated last month
• RunpeiDong / DreamLLM
  [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation
  ☆430Updated 4 months ago
• mutonix / Vript
  ☆141Updated 3 months ago
• rongyaofang / PUMA
  Empowering Unified MLLM with Multi-granular Visual Generation
  ☆119Updated 3 months ago
• ShareGPT4Omni / ShareGPT4V
  [ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions
  ☆210Updated 9 months ago
• AdaCache-DiT / AdaCache
  Adaptive Caching for Faster Video Generation with Diffusion Transformers
  ☆144Updated 5 months ago
• pkunlp-icler / FastV
  [ECCV 2024 Oral] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Langua…
  ☆407Updated 3 months ago
• LMM101 / Awesome-Multimodal-Next-Token-Prediction
  [Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey
  ☆416Updated 2 months ago
• invictus717 / MiCo
  Explore the Limits of Omni-modal Pretraining at Scale
  ☆97Updated 7 months ago
• DAMO-NLP-SG / Inf-CLIP
  [CVPR 2025 Highlight] The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for C…
  ☆240Updated 3 months ago
• dvlab-research / VisionZip
  Official repository for VisionZip (CVPR 2025)
  ☆265Updated last month
• NJU-PCALab / OpenVid-1M
  [ICLR 2025] OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generation
  ☆272Updated last month
• baaivision / DIVA
  [ICLR 2025] Diffusion Feedback Helps CLIP See Better
  ☆272Updated 2 months ago
• MMStar-Benchmark / MMStar
  [NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"
  ☆174Updated 6 months ago
• rccchoudhury / rlt
  Official Implementation for our NeurIPS 2024 paper, "Don't Look Twice: Run-Length Tokenization for Faster Video Transformers".
  ☆207Updated 2 weeks ago