Alternatives and similar repositories for vila-u:

Users that are interested in vila-u are comparing it to the libraries listed below

• ByteFlow-AI / TokenFlow
  🔥 Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".
  ☆253Updated last month
• baaivision / EVE
  EVE Series: Encoder-Free Vision-Language Models from BAAI
  ☆295Updated last week
• bronyayang / Law_of_Vision_Representation_in_MLLMs
  Official implementation of the Law of Vision Representation in MLLMs
  ☆149Updated 3 months ago
• EvolvingLMMs-Lab / LongVA
  Long Context Transfer from Language to Vision
  ☆360Updated 3 months ago
• AdaCache-DiT / AdaCache
  Adaptive Caching for Faster Video Generation with Diffusion Transformers
  ☆142Updated 3 months ago
• rongyaofang / PUMA
  Empowering Unified MLLM with Multi-granular Visual Generation
  ☆117Updated last month
• xuyang-liu16 / Awesome-Generation-Acceleration
  📚 Collection of awesome generation acceleration resources.
  ☆139Updated this week
• 42Shawn / LLaVA-PruMerge
  LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models
  ☆116Updated 9 months ago
• FreedomIntelligence / LongLLaVA
  LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
  ☆189Updated last month
• lxa9867 / Awesome-Autoregressive-Visual-Generation
  This is a repo to track the latest autoregressive visual generation papers.
  ☆139Updated last week
• NJU-PCALab / OpenVid-1M
  [ICLR 2025] OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generation
  ☆243Updated last week
• showlab / Awesome-Unified-Multimodal-Models
  📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.
  ☆374Updated last month
• baaivision / NOVA
  [ICLR 2025] Autoregressive Video Generation without Vector Quantization
  ☆385Updated this week
• mit-han-lab / hart
  HART: Efficient Visual Generation with Hybrid Autoregressive Transformer
  ☆418Updated 4 months ago
• pkunlp-icler / FastV
  [ECCV 2024 Oral] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Langua…
  ☆364Updated last month
• MonoFormer / MonoFormer
  The official implementation for "MonoFormer: One Transformer for Both Diffusion and Autoregression"
  ☆84Updated 4 months ago
• PKU-YuanGroup / Video-Bench
  A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!
  ☆125Updated last year
• invictus717 / MiCo
  Explore the Limits of Omni-modal Pretraining at Scale
  ☆96Updated 5 months ago
• ChaofanTao / Autoregressive-Models-in-Vision-Survey
  The paper collections for the autoregressive models in vision.
  ☆406Updated this week
• mutonix / Vript
  ☆134Updated last month
• daixiangzi / VAR-CLIP
  Implements VAR+CLIP for text-to-image (T2I) generation
  ☆119Updated 3 weeks ago
• OpenGVLab / MM-Interleaved
  MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer
  ☆210Updated 10 months ago
• llyx97 / TempCompass
  [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …
  ☆101Updated 2 weeks ago
• MMStar-Benchmark / MMStar
  [NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"
  ☆165Updated 4 months ago
• NUS-HPC-AI-Lab / SpeeD
  SpeeD: A Closer Look at Time Steps is Worthy of Triple Speed-Up for Diffusion Model Training
  ☆174Updated 3 weeks ago
• rccchoudhury / rlt
  Official Implementation for our NeurIPS 2024 paper, "Don't Look Twice: Run-Length Tokenization for Faster Video Transformers".
  ☆191Updated 2 months ago
• keshik6 / HourVideo
  [NeurIPS 2024] Official code for HourVideo: 1-Hour Video Language Understanding
  ☆62Updated last month
• yfzhang114 / SliME
  ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models
  ☆151Updated last month
• thu-nics / DiTFastAttn
  ☆144Updated last month