rongyaofang / PUMA
Empowering Unified MLLM with Multi-granular Visual Generation
☆119Updated 3 months ago
Alternatives and similar repositories for PUMA:
Users that are interested in PUMA are comparing it to the libraries listed below
- Official repository of "GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing"☆214Updated 3 weeks ago
- A collection of vision foundation models unifying understanding and generation.☆49Updated 3 months ago
- WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generation☆75Updated last week
- ImageGen-CoT: Enhancing Text-to-Image In-context Learning with Chain-of-Thought Reasoning☆26Updated last week
- official repo for "VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generation" [EMNLP2024]☆89Updated 2 months ago
- T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generation☆73Updated 3 weeks ago
- Code for: "Long-Context Autoregressive Video Modeling with Next-Frame Prediction"☆166Updated last week
- Video Generation, Physical Commonsense, Semantic Adherence, VideoCon-Physics☆89Updated last month
- [CVPR 2025 (Oral)] Open implementation of "RandAR"☆99Updated 3 weeks ago
- Official implementation of MARS: Mixture of Auto-Regressive Models for Fine-grained Text-to-image Synthesis☆83Updated 9 months ago
- [NeurIPS 2024 D&B Track] Official Repo for "LVD-2M: A Long-take Video Dataset with Temporally Dense Captions"☆54Updated 6 months ago
- Code Release of Harmonizing Visual Representations for Unified Multimodal Understanding and Generation☆58Updated last week
- Code for MetaMorph Multimodal Understanding and Generation via Instruction Tuning☆86Updated this week
- The code and data of Paper: Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generation☆99Updated 5 months ago
- Unifying Visual Understanding and Generation with Dual Visual Vocabularies 🌈☆37Updated 3 weeks ago
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆90Updated this week
- Official Pytorch implementation for LARP: Tokenizing Videos with a Learned Autoregressive Generative Prior (ICLR 2025 Oral).☆63Updated 2 months ago
- The official implementation for "MonoFormer: One Transformer for Both Diffusion and Autoregression"☆86Updated 6 months ago
- [CVPR2025 Highlight] PAR: Parallelized Autoregressive Visual Generation. https://yuqingwang1029.github.io/PAR-project☆146Updated 3 weeks ago
- [ICLR'25] Reconstructive Visual Instruction Tuning☆78Updated last week
- Code and Data for "GenAI Arena: An Open Evaluation Platform for Generative Models" [NeurIPS 2024]☆18Updated 7 months ago
- Official implementation of LiFT: Leveraging Human Feedback for Text-to-Video Model Alignment.☆70Updated 2 weeks ago
- Official Implementation of VideoDPO☆84Updated 3 months ago
- Official Implementation of ICLR'24: Kosmos-G: Generating Images in Context with Multimodal Large Language Models☆70Updated 10 months ago
- FQGAN: Factorized Visual Tokenization and Generation☆47Updated 2 weeks ago
- [arXiv: 2502.05178] QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation☆68Updated last month
- [NeurIPS 2024] The official implement of research paper "FreeLong : Training-Free Long Video Generation with SpectralBlend Temporal Atten…☆42Updated last month
- ☆60Updated 3 weeks ago
- 📖 This is a repository for organizing papers, codes, and other resources related to unified multimodal models.☆171Updated last week
- Official implementation of the paper: REPA-E: Unlocking VAE for End-to-End Tuning of Latent Diffusion Transformers☆49Updated this week