mit-han-lab / vila-uLinks
[ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation
☆326Updated last month
Alternatives and similar repositories for vila-u
Users that are interested in vila-u are comparing it to the libraries listed below
Sorting:
- Code for MetaMorph Multimodal Understanding and Generation via Instruction Tuning☆176Updated last month
- Pytorch implementation for the paper titled "SimpleAR: Pushing the Frontier of Autoregressive Visual Generation"☆354Updated last month
- [CVPR 2025] 🔥 Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".☆330Updated 2 months ago
- EVE Series: Encoder-Free Vision-Language Models from BAAI☆327Updated 3 months ago
- Official repository of "GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing"☆250Updated last month
- [ICLR 2025] Autoregressive Video Generation without Vector Quantization☆509Updated last week
- Video-R1: Reinforcing Video Reasoning in MLLMs [🔥the first paper to explore R1 for video]☆546Updated this week
- [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation☆441Updated 6 months ago
- VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning☆136Updated 2 weeks ago
- Empowering Unified MLLM with Multi-granular Visual Generation☆122Updated 4 months ago
- Official implementation of the Law of Vision Representation in MLLMs☆155Updated 6 months ago
- Official implementation of UnifiedReward & UnifiedReward-Think☆390Updated last week
- This is a repo to track the latest autoregressive visual generation papers.☆334Updated this week
- [Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey☆443Updated 4 months ago
- A Unified Tokenizer for Visual Generation and Understanding☆314Updated 2 weeks ago
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆105Updated last month
- Long Context Transfer from Language to Vision☆375Updated 2 months ago
- Official Implementation for our NeurIPS 2024 paper, "Don't Look Twice: Run-Length Tokenization for Faster Video Transformers".☆211Updated 2 months ago
- Official repo and evaluation implementation of VSI-Bench☆489Updated 3 months ago
- [CVPR2025 Highlight] Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models☆192Updated last month
- Code for "Scaling Language-Free Visual Representation Learning" paper (Web-SSL).☆129Updated last month
- Adaptive Caching for Faster Video Generation with Diffusion Transformers☆147Updated 6 months ago
- ☆148Updated 4 months ago
- [NeurIPS 2024] Classification Done Right for Vision-Language Pre-Training☆209Updated 2 months ago
- [CVPR'2025] VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".☆163Updated last week
- LaVIT: Empower the Large Language Model to Understand and Generate Visual Content☆580Updated 7 months ago
- [AAAI-25] Cobra: Extending Mamba to Multi-modal Large Language Model for Efficient Inference☆276Updated 4 months ago
- [CVPR2025 Highlight] PAR: Parallelized Autoregressive Visual Generation. https://yuqingwang1029.github.io/PAR-project☆158Updated 2 months ago
- [ICLR 2025] Diffusion Feedback Helps CLIP See Better☆279Updated 4 months ago
- LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture☆203Updated 4 months ago