mit-han-lab / vila-uLinks
[ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation
☆373Updated 3 months ago
Alternatives and similar repositories for vila-u
Users that are interested in vila-u are comparing it to the libraries listed below
Sorting:
- Code for MetaMorph Multimodal Understanding and Generation via Instruction Tuning☆199Updated 3 months ago
- Long-RL: Scaling RL to Long Sequences☆545Updated this week
- [CVPR 2025] 🔥 Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".☆364Updated last week
- Official repository of "GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing"☆270Updated 3 months ago
- Official implementation of UnifiedReward & UnifiedReward-Think☆485Updated last week
- Pytorch implementation for the paper titled "SimpleAR: Pushing the Frontier of Autoregressive Visual Generation"☆390Updated last month
- EVE Series: Encoder-Free Vision-Language Models from BAAI☆340Updated last week
- A Unified Tokenizer for Visual Generation and Understanding☆363Updated last week
- Selftok: Discrete Visual Tokens of Autoregression, by Diffusion, and for Reasoning☆198Updated 2 months ago
- Empowering Unified MLLM with Multi-granular Visual Generation☆127Updated 6 months ago
- This is a repo to track the latest autoregressive visual generation papers.☆377Updated last month
- ☆188Updated this week
- [CVPR'2025] VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".☆176Updated last month
- Official repository for VisionZip (CVPR 2025)☆325Updated last week
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆119Updated last month
- [Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey☆446Updated 6 months ago
- [ICLR 2025] Diffusion Feedback Helps CLIP See Better☆283Updated 6 months ago
- [ICLR 2025] Autoregressive Video Generation without Vector Quantization☆553Updated 2 weeks ago
- 📖 This is a repository for organizing papers, codes, and other resources related to unified multimodal models.☆263Updated last week
- WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generation☆135Updated last month
- Video-R1: Reinforcing Video Reasoning in MLLMs [🔥the first paper to explore R1 for video]☆642Updated this week
- Official Implementation for our NeurIPS 2024 paper, "Don't Look Twice: Run-Length Tokenization for Faster Video Transformers".☆221Updated 4 months ago
- [ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions☆229Updated last year
- Long Context Transfer from Language to Vision☆385Updated 4 months ago
- An official implementation of DanceGRPO: Unleashing GRPO on Visual Generation☆537Updated this week
- [ICLR'25] Reconstructive Visual Instruction Tuning☆101Updated 3 months ago
- Code for "Scaling Language-Free Visual Representation Learning" paper (Web-SSL).☆168Updated 3 months ago
- [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation☆452Updated 8 months ago
- 📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.☆636Updated 2 weeks ago
- LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models☆141Updated last month