🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).
☆551Apr 4, 2025Updated last year
Alternatives and similar repositories for Awesome-LLMs-meet-Multimodal-Generation
Users that are interested in Awesome-LLMs-meet-Multimodal-Generation are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Let's finetune video generation models!☆551Sep 15, 2025Updated 10 months ago
- A curated list of recent diffusion models for video generation, editing, and various other applications.☆5,737Updated this week
- Code for FreeTraj, a tuning-free method for trajectory-controllable video generation☆114Sep 19, 2025Updated 10 months ago
- [ICLR & NeurIPS 2025] Repository for Show-o series, One Single Transformer to Unify Multimodal Understanding and Generation.☆1,965Jan 8, 2026Updated 6 months ago
- 📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.☆830Oct 10, 2025Updated 9 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation☆1,960Aug 15, 2024Updated last year
- Official repository of "GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing"☆317Sep 28, 2025Updated 10 months ago
- [ArXiv 2025] A survey about controllable video generation: This repo is the official awesome of "Controllable video generation: A survey…☆760Apr 13, 2026Updated 3 months ago
- Official Implementation of VideoDPO☆169Jun 1, 2025Updated last year
- [ICLR 2024] Code for FreeNoise based on VideoCrafter☆428Aug 25, 2025Updated 11 months ago
- [ICLR 2025] Autoregressive Video Generation without Vector Quantization☆657Oct 29, 2025Updated 9 months ago
- [CVPR 2025] Official code of "DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Long…☆323Mar 30, 2025Updated last year
- [CVPR 2024] Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners☆155Jul 6, 2024Updated 2 years ago
- [Neurips 2025 NextVid Workshop Oral✨] Official Implementation of VideoGen-of-Thought: Step-by-step generating multi-shot video with minim …☆63Sep 22, 2025Updated 10 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- [NeurIPS 2025] T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoT☆433Sep 18, 2025Updated 10 months ago
- A reading list of video generation☆723Jul 22, 2026Updated last week
- [ICLR 2024 Spotlight] Official implementation of ScaleCrafter for higher-resolution visual generation at inference time.☆507Mar 7, 2024Updated 2 years ago
- [CSUR] A Survey on Video Diffusion Models☆2,307Jun 22, 2026Updated last month
- LVDM: Latent Video Diffusion Models for High-Fidelity Long Video Generation☆503Nov 16, 2024Updated last year
- 🔥🔥🔥A curated list of papers on recent diffusion-based high-resolution image and video synthesis works.☆169Dec 26, 2024Updated last year
- A collection of awesome video generation studies.☆778Mar 31, 2026Updated 3 months ago
- a collection of awesome autoregressive visual generation models☆82Apr 17, 2025Updated last year
- This repo contains the code for 1D tokenizer and generator☆1,168Mar 20, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- SEED-Voken: A Series of Powerful Visual Tokenizers☆1,020Nov 25, 2025Updated 8 months ago
- [NeurIPS 2025 Spotlight] A Unified Tokenizer for Visual Generation and Understanding☆529Nov 14, 2025Updated 8 months ago
- Official repository of IDEA-Bench☆41Jan 24, 2025Updated last year
- [CVPR 2024] Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers☆700Oct 25, 2024Updated last year
- Official implementation of BLIP3o-Series☆1,663Nov 29, 2025Updated 8 months ago
- [ACM Multimedia 2025 Datasets Track] EditWorld: Simulating World Dynamics for Instruction-Following Image Editing☆142Aug 2, 2025Updated 11 months ago
- [TMLR 2025🔥] A survey for the autoregressive models in vision.☆805May 5, 2026Updated 2 months ago
- [Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey☆476Jan 17, 2025Updated last year
- Latest Advances on Multimodal Large Language Models☆17,959Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- collection of diffusion model papers categorized by their subareas☆2,220Mar 16, 2026Updated 4 months ago
- [NeurIPS 2025] An official implementation of Flow-GRPO: Training Flow Matching Models via Online RL☆2,440May 7, 2026Updated 2 months ago
- A collection of resources on controllable generation with text-to-image diffusion models.☆1,111Dec 31, 2024Updated last year
- This is a repo to track the latest autoregressive visual generation papers.☆430Jun 25, 2025Updated last year
- [Arxiv 2025] Official PyTorch implementation of DiffMoE, TC-DiT, EC-DiT and Dense DiT☆175Oct 21, 2025Updated 9 months ago
- LaVIT: Empower the Large Language Model to Understand and Generate Visual Content☆603Oct 6, 2024Updated last year
- [NeurIPS 2024 Best Paper Award][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Mod…☆8,714Nov 10, 2025Updated 8 months ago