rongyaofang / PUMA
Empowering Unified MLLM with Multi-granular Visual Generation
β114Updated this week
Alternatives and similar repositories for PUMA:
Users that are interested in PUMA are comparing it to the libraries listed below
- π₯ Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".β222Updated 3 weeks ago
- Liquid: Language Models are Scalable Multi-modal Generatorsβ60Updated last month
- official repo for "VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generation" [EMNLP2024]β67Updated last month
- FQGAN: Factorized Visual Tokenization and Generationβ39Updated last week
- [NeurlPS 2024] One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videosβ95Updated 3 weeks ago
- The code and data of Paper: Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generationβ78Updated 2 months ago
- A collection of vision foundation models unifying understanding and generation.β40Updated 2 weeks ago
- π₯ Aurora Series: A more efficient multimodal large language model series for video.β62Updated 2 months ago
- T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationβ59Updated this week
- [NeurIPS 2024 D&B Track] Official Repo for "LVD-2M: A Long-take Video Dataset with Temporally Dense Captions"β45Updated 3 months ago
- Official implementation of MARS: Mixture of Auto-Regressive Models for Fine-grained Text-to-image Synthesisβ83Updated 6 months ago
- The official implementation for "MonoFormer: One Transformer for Both Diffusion and Autoregression"β80Updated 3 months ago
- β132Updated this week
- Code for ROICtrl: Boosting Instance Control for Visual Generationβ99Updated last month
- VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationβ199Updated this week
- Video Generation, Physical Commonsense, Semantic Adherence, VideoCon-Physicsβ70Updated 3 months ago
- β43Updated 2 weeks ago
- Implements VAR+CLIP for text-to-image (T2I) generationβ112Updated 2 weeks ago
- Official Implementation of ICLR'24: Kosmos-G: Generating Images in Context with Multimodal Large Language Modelsβ59Updated 7 months ago
- The official code of the paper "PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction".β50Updated last week
- DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perceptionβ130Updated last month
- [Neurips 2024] Video Diffusion Models are Training-free Motion Interpreter and Controllerβ31Updated last month
- Official code for paper: Auto Cherry-Picker: Learning from High-quality Generative Data Driven by Languageβ22Updated this week
- [NeurIPS 2024] Efficient Multi-modal Models via Stage-wise Visual Context Compressionβ50Updated 5 months ago
- β124Updated 3 months ago
- CoDe: Collaborative Decoding Makes Visual Auto-Regressive Modeling Efficientβ75Updated last month
- β221Updated 6 months ago
- Diffusion Powers Video Tokenizer for Comprehension and Generationβ40Updated last month
- [NeurIPS 2024] The official implement of research paper "FreeLong : Training-Free Long Video Generation with SpectralBlend Temporal Attenβ¦β34Updated last month