YingqingHe / Awesome-LLMs-meet-Multimodal-Generation
π₯π₯π₯ A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).
β461Updated 3 weeks ago
Alternatives and similar repositories for Awesome-LLMs-meet-Multimodal-Generation:
Users that are interested in Awesome-LLMs-meet-Multimodal-Generation are comparing it to the libraries listed below
- π This is a repository for organizing papers, codes and other resources related to unified multimodal models.β506Updated 2 weeks ago
- [TMLR 2025π₯] A survey for the autoregressive models in vision.β508Updated this week
- A collection of awesome video generation studies.β501Updated last week
- [CVPR 2025] π₯ Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".β316Updated last month
- A list of works on evaluation of visual generation models, including evaluation metrics, models, and systemsβ282Updated this week
- Official implementation of Unified Reward Model for Multimodal Understanding and Generation.β242Updated this week
- [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creationβ434Updated 4 months ago
- [ICLR 2025] Autoregressive Video Generation without Vector Quantizationβ477Updated this week
- A reading list of video generationβ553Updated this week
- The official GitHub page for the review paper "Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Mβ¦β497Updated last year
- [Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Surveyβ419Updated 3 months ago
- This is a repo to track the latest autoregressive visual generation papers.β272Updated last week
- A list for Text-to-Video, Image-to-Video worksβ233Updated 4 months ago
- [ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationβ299Updated this week
- SEED-Voken: A Series of Powerful Visual Tokenizersβ868Updated 2 months ago
- LaVIT: Empower the Large Language Model to Understand and Generate Visual Contentβ577Updated 6 months ago
- VideoVAE+: Large Motion Video Autoencoding with Cross-modal Video VAEβ314Updated 3 months ago
- [CVPR 2024] Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachersβ595Updated 6 months ago
- π This is a repository for organizing papers, codes, and other resources related to unified multimodal models.β173Updated 2 weeks ago
- This repo contains the code for 1D tokenizer and generatorβ838Updated last month
- Video-R1: Reinforcing Video Reasoning in MLLMs [π₯the first paper to explore R1 for video]β469Updated this week
- Official repo for paper "MiraData: A Large-Scale Video Dataset with Long Durations and Structured Captions"β431Updated 7 months ago
- Official repository of "GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing"β230Updated last month
- Pytorch implementation for the paper titled "SimpleAR: Pushing the Frontier of Autoregressive Visual Generation"β240Updated this week
- Implementation of MagViT2 Tokenizer in Pytorchβ600Updated 3 months ago
- Papers and resources on Controllable Generation using Diffusion Models, including ControlNet, DreamBooth, IP-Adapter.β458Updated 2 weeks ago
- Official repo and evaluation implementation of VSI-Benchβ463Updated last month
- [CVPR 2024] Intelligent Grimm - Open-ended Visual Storytelling via Latent Diffusion Modelsβ246Updated 4 months ago
- Official implementation of SEED-LLaMA (ICLR 2024).β610Updated 7 months ago
- [ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captionsβ214Updated 9 months ago