Alternatives and similar repositories for vila-u:

Users that are interested in vila-u are comparing it to the libraries listed below

• baaivision / EVE
  EVE Series: Encoder-Free Vision-Language Models from BAAI
  ☆313Updated 3 weeks ago
• ByteFlow-AI / TokenFlow
  [CVPR 2025] 🔥 Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".
  ☆292Updated 2 weeks ago
• rongyaofang / PUMA
  Empowering Unified MLLM with Multi-granular Visual Generation
  ☆119Updated 2 months ago
• Yxxxb / VoCo-LLaMA
  [CVPR 2025] VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".
  ☆134Updated 3 weeks ago
• bronyayang / Law_of_Vision_Representation_in_MLLMs
  Official implementation of the Law of Vision Representation in MLLMs
  ☆151Updated 4 months ago
• rccchoudhury / rlt
  Official Implementation for our NeurIPS 2024 paper, "Don't Look Twice: Run-Length Tokenization for Faster Video Transformers".
  ☆201Updated 3 months ago
• baaivision / NOVA
  [ICLR 2025] Autoregressive Video Generation without Vector Quantization
  ☆419Updated this week
• rongyaofang / GoT
  Official repository of "GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing"
  ☆167Updated this week
• FoundationVision / UniTok
  A Unified Tokenizer for Visual Generation and Understanding
  ☆210Updated 3 weeks ago
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆368Updated last week
• 42Shawn / LLaVA-PruMerge
  LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models
  ☆119Updated 10 months ago
• AdaCache-DiT / AdaCache
  Adaptive Caching for Faster Video Generation with Diffusion Transformers
  ☆142Updated 4 months ago
• NJU-PCALab / OpenVid-1M
  [ICLR 2025] OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generation
  ☆256Updated 3 weeks ago
• mutonix / Vript
  ☆138Updated 2 months ago
• kyegomez / NaViT
  My implementation of "Patch n’ Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution"
  ☆224Updated last month
• RunpeiDong / DreamLLM
  [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation
  ☆427Updated 3 months ago
• YuqingWang1029 / PAR
  [CVPR2025] PAR: Parallelized Autoregressive Visual Generation. https://yuqingwang1029.github.io/PAR-project/
  ☆127Updated this week
• OpenGVLab / MM-Interleaved
  MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer
  ☆220Updated 11 months ago
• yfzhang114 / SliME
  ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models
  ☆154Updated 2 months ago
• llyx97 / TempCompass
  [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …
  ☆107Updated last month
• lxa9867 / Awesome-Autoregressive-Visual-Generation
  This is a repo to track the latest autoregressive visual generation papers.
  ☆169Updated this week
• dongyh20 / Insight-V
  [CVPR2025] Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models
  ☆165Updated this week
• vision-x-nyu / thinking-in-space
  Official repo and evaluation implementation of VSI-Bench
  ☆421Updated 3 weeks ago
• showlab / Awesome-Unified-Multimodal-Models
  📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.
  ☆415Updated last week
• HJYao00 / DenseConnector
  【NeurIPS 2024】Dense Connector for MLLMs
  ☆157Updated 5 months ago
• baaivision / DIVA
  [ICLR 2025] Diffusion Feedback Helps CLIP See Better
  ☆268Updated 2 months ago
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆130Updated 4 months ago
• MonoFormer / MonoFormer
  The official implementation for "MonoFormer: One Transformer for Both Diffusion and Autoregression"
  ☆86Updated 5 months ago
• MMStar-Benchmark / MMStar
  [NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"
  ☆168Updated 5 months ago
• alibaba / conv-llava
  ☆111Updated 7 months ago