mit-han-lab / vila-uLinks
[ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation
☆358Updated 2 months ago
Alternatives and similar repositories for vila-u
Users that are interested in vila-u are comparing it to the libraries listed below
Sorting:
- Code for MetaMorph Multimodal Understanding and Generation via Instruction Tuning☆193Updated 2 months ago
- [CVPR 2025] 🔥 Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".☆351Updated this week
- Official implementation of UnifiedReward & UnifiedReward-Think☆457Updated this week
- Official repository of "GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing"☆263Updated 2 months ago
- EVE Series: Encoder-Free Vision-Language Models from BAAI☆333Updated this week
- Pytorch implementation for the paper titled "SimpleAR: Pushing the Frontier of Autoregressive Visual Generation"☆383Updated 3 weeks ago
- A Unified Tokenizer for Visual Generation and Understanding☆354Updated last month
- Long-RL: Scaling RL to Long Sequences☆323Updated this week
- Empowering Unified MLLM with Multi-granular Visual Generation☆126Updated 5 months ago
- Official implementation of the Law of Vision Representation in MLLMs☆160Updated 7 months ago
- [CVPR'2025] VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".☆176Updated 3 weeks ago
- ☆171Updated 2 weeks ago
- [ICLR 2025] Autoregressive Video Generation without Vector Quantization☆544Updated last month
- This is a repo to track the latest autoregressive visual generation papers.☆364Updated 2 weeks ago
- Official repository for VisionZip (CVPR 2025)☆319Updated last month
- [ICLR 2025] Diffusion Feedback Helps CLIP See Better☆283Updated 5 months ago
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆113Updated last month
- [ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions☆224Updated last year
- [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation☆450Updated 7 months ago
- Code for "Scaling Language-Free Visual Representation Learning" paper (Web-SSL).☆157Updated 2 months ago
- Video-R1: Reinforcing Video Reasoning in MLLMs [🔥the first paper to explore R1 for video]☆609Updated last month
- 📖 This is a repository for organizing papers, codes, and other resources related to unified multimodal models.☆256Updated 2 weeks ago
- DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception☆146Updated 7 months ago
- A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!☆128Updated last year
- [ICLR'25] Reconstructive Visual Instruction Tuning☆97Updated 3 months ago
- [Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey☆446Updated 5 months ago
- VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning☆161Updated last month
- Selftok: Discrete Visual Tokens of Autoregression, by Diffusion, and for Reasoning☆185Updated last month
- Long Context Transfer from Language to Vision☆384Updated 3 months ago
- Official Implementation for our NeurIPS 2024 paper, "Don't Look Twice: Run-Length Tokenization for Faster Video Transformers".☆219Updated 3 months ago