mit-han-lab / vila-uLinks
[ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation
☆348Updated last month
Alternatives and similar repositories for vila-u
Users that are interested in vila-u are comparing it to the libraries listed below
Sorting:
- Code for MetaMorph Multimodal Understanding and Generation via Instruction Tuning☆191Updated 2 months ago
- Pytorch implementation for the paper titled "SimpleAR: Pushing the Frontier of Autoregressive Visual Generation"☆371Updated this week
- [CVPR 2025] 🔥 Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".☆337Updated 3 months ago
- EVE Series: Encoder-Free Vision-Language Models from BAAI☆330Updated 3 months ago
- Official repository of "GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing"☆253Updated last month
- [ICLR 2025] Autoregressive Video Generation without Vector Quantization☆532Updated last month
- Video-R1: Reinforcing Video Reasoning in MLLMs [🔥the first paper to explore R1 for video]☆569Updated 3 weeks ago
- Empowering Unified MLLM with Multi-granular Visual Generation☆124Updated 5 months ago
- [Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey☆446Updated 5 months ago
- Official implementation of UnifiedReward & UnifiedReward-Think☆417Updated last week
- A Unified Tokenizer for Visual Generation and Understanding☆339Updated last month
- [ICLR 2025] OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generation☆302Updated 3 weeks ago
- This is a repo to track the latest autoregressive visual generation papers.☆356Updated 3 weeks ago
- Official implementation of the Law of Vision Representation in MLLMs☆156Updated 7 months ago
- Selftok: Discrete Visual Tokens of Autoregression, by Diffusion, and for Reasoning☆170Updated 3 weeks ago
- [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation☆448Updated 6 months ago
- LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models☆133Updated last year
- ☆310Updated last week
- Long Context Transfer from Language to Vision☆381Updated 3 months ago
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆111Updated 2 weeks ago
- Official repository for VisionZip (CVPR 2025)☆301Updated 3 weeks ago
- VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning☆152Updated last week
- [CVPR'2025] VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".☆168Updated this week
- Scaling Diffusion Transformers with Mixture of Experts☆339Updated 9 months ago
- SEED-Voken: A Series of Powerful Visual Tokenizers☆893Updated 4 months ago
- MLLM-Tool: A Multimodal Large Language Model For Tool Agent Learning☆125Updated last year
- 📚 Collection of awesome generation acceleration resources.☆270Updated 2 months ago
- Official repo and evaluation implementation of VSI-Bench☆512Updated 3 months ago
- 📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.☆578Updated 2 weeks ago
- [NeurIPS 2024] Classification Done Right for Vision-Language Pre-Training☆209Updated 3 months ago