mit-han-lab / vila-uLinks
[ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation
☆394Updated 5 months ago
Alternatives and similar repositories for vila-u
Users that are interested in vila-u are comparing it to the libraries listed below
Sorting:
- Long-RL: Scaling RL to Long Sequences (NeurIPS 2025)☆644Updated 3 weeks ago
- [CVPR 2025] 🔥 Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".☆393Updated 2 months ago
- Official repository of "GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing"☆291Updated 3 weeks ago
- Code for MetaMorph Multimodal Understanding and Generation via Instruction Tuning☆214Updated 6 months ago
- [NeurIPS 2025 Spotlight] A Unified Tokenizer for Visual Generation and Understanding☆425Updated last month
- Pytorch implementation for the paper titled "SimpleAR: Pushing the Frontier of Autoregressive Visual Generation"☆410Updated 4 months ago
- EVE Series: Encoder-Free Vision-Language Models from BAAI☆353Updated 3 months ago
- Official implementation of UnifiedReward & [NeurIPS 2025] UnifiedReward-Think☆574Updated this week
- Selftok: Discrete Visual Tokens of Autoregression, by Diffusion, and for Reasoning☆224Updated 4 months ago
- ☆254Updated last week
- This is a repo to track the latest autoregressive visual generation papers.☆405Updated 3 months ago
- Empowering Unified MLLM with Multi-granular Visual Generation☆130Updated 9 months ago
- [ICLR 2025] Autoregressive Video Generation without Vector Quantization☆578Updated last month
- [ICLR 2025] Diffusion Feedback Helps CLIP See Better☆289Updated 9 months ago
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆129Updated 4 months ago
- High-performance Image Tokenizers for VAR and AR☆291Updated 5 months ago
- [CVPR 2025 (Oral)] Open implementation of "RandAR"☆197Updated 3 months ago
- [ICLR'25] Reconstructive Visual Instruction Tuning☆121Updated 6 months ago
- [CVPR'2025] VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".☆191Updated 4 months ago
- Official Implementation of Paper Transfer between Modalities with MetaQueries☆253Updated last week
- [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation☆459Updated 10 months ago
- MLLM-Tool: A Multimodal Large Language Model For Tool Agent Learning☆134Updated 2 weeks ago
- [Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey☆451Updated 9 months ago
- [ICCV2025]Code Release of Harmonizing Visual Representations for Unified Multimodal Understanding and Generation☆174Updated 5 months ago
- TokLIP: Marry Visual Tokens to CLIP for Multimodal Comprehension and Generation☆226Updated 2 months ago
- [COLM'25] Official implementation of the Law of Vision Representation in MLLMs☆168Updated 2 weeks ago
- Pixel-Level Reasoning Model trained with RL [NeuIPS25]☆238Updated last month
- Official Implementation for our NeurIPS 2024 paper, "Don't Look Twice: Run-Length Tokenization for Faster Video Transformers".☆228Updated 6 months ago
- LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models☆150Updated 3 weeks ago
- 📖 This is a repository for organizing papers, codes, and other resources related to unified multimodal models.☆319Updated last week