mit-han-lab / vila-uLinks
[ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation
☆418Updated 9 months ago
Alternatives and similar repositories for vila-u
Users that are interested in vila-u are comparing it to the libraries listed below
Sorting:
- Long-RL: Scaling RL to Long Sequences (NeurIPS 2025)☆691Updated 4 months ago
- Code for MetaMorph Multimodal Understanding and Generation via Instruction Tuning☆234Updated 2 weeks ago
- [CVPR 2025] 🔥 Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".☆433Updated 6 months ago
- Official repository of "GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing"☆307Updated 4 months ago
- EVE Series: Encoder-Free Vision-Language Models from BAAI☆367Updated 6 months ago
- Pytorch implementation for the paper titled "SimpleAR: Pushing the Frontier of Autoregressive Visual Generation"☆426Updated 7 months ago
- ☆318Updated last month
- [NeurIPS 2025 Spotlight] A Unified Tokenizer for Visual Generation and Understanding☆507Updated 2 months ago
- Official implementation of UnifiedReward & [NeurIPS 2025] UnifiedReward-Think & UnifiedReward-Flex☆699Updated this week
- This is a repo to track the latest autoregressive visual generation papers.☆429Updated 7 months ago
- Selftok: Discrete Visual Tokens of Autoregression, by Diffusion, and for Reasoning☆236Updated 8 months ago
- [ICLR'25] Reconstructive Visual Instruction Tuning☆135Updated 10 months ago
- Cambrian-S: Towards Spatial Supersensing in Video☆488Updated last month
- [CVPR'2025] VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".☆204Updated 7 months ago
- [ICLR 2025] Diffusion Feedback Helps CLIP See Better☆299Updated last year
- Towards Scalable Pre-training of Visual Tokenizers for Generation☆440Updated last month
- Empowering Unified MLLM with Multi-granular Visual Generation☆129Updated last year
- Official Implementation of Paper Transfer between Modalities with MetaQueries☆300Updated 4 months ago
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆138Updated 8 months ago
- [ICLR 2025] Autoregressive Video Generation without Vector Quantization☆625Updated 3 months ago
- PyTorch implementation of NEPA☆308Updated 2 weeks ago
- [CVPR 2025 (Oral)] Open implementation of "RandAR"☆206Updated 6 months ago
- High-performance Image Tokenizers for VAR and AR☆302Updated 9 months ago
- WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generation☆183Updated 3 months ago
- 📖 This is a repository for organizing papers, codes, and other resources related to unified multimodal models.☆349Updated last month
- [Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey☆477Updated last year
- Official repository for VisionZip (CVPR 2025)☆405Updated 6 months ago
- LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models☆163Updated 4 months ago
- Implements VAR+CLIP for text-to-image (T2I) generation☆147Updated last year
- [ICCV2025]Code Release of Harmonizing Visual Representations for Unified Multimodal Understanding and Generation☆186Updated 8 months ago