🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).
☆546Apr 4, 2025Updated last year
Alternatives and similar repositories for Awesome-LLMs-meet-Multimodal-Generation
Users that are interested in Awesome-LLMs-meet-Multimodal-Generation are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Let's finetune video generation models!☆550Sep 15, 2025Updated 9 months ago
- A curated list of recent diffusion models for video generation, editing, and various other applications.☆5,714Jun 16, 2026Updated 3 weeks ago
- Code for FreeTraj, a tuning-free method for trajectory-controllable video generation☆114Sep 19, 2025Updated 9 months ago
- 📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.☆828Oct 10, 2025Updated 8 months ago
- [ICLR & NeurIPS 2025] Repository for Show-o series, One Single Transformer to Unify Multimodal Understanding and Generation.☆1,959Jan 8, 2026Updated 6 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation☆1,959Aug 15, 2024Updated last year
- Official repository of "GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing"☆316Sep 28, 2025Updated 9 months ago
- Official Implementation of VideoDPO☆169Jun 1, 2025Updated last year
- [CVPR 2025] Official code of "DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Long…☆324Mar 30, 2025Updated last year
- [ICLR 2025] Autoregressive Video Generation without Vector Quantization☆652Oct 29, 2025Updated 8 months ago
- [ICLR 2024] Code for FreeNoise based on VideoCrafter☆429Aug 25, 2025Updated 10 months ago
- [NeurIPS 2025] T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoT☆433Sep 18, 2025Updated 9 months ago
- [ArXiv 2025] A survey about controllable video generation: This repo is the official awesome of "Controllable video generation: A survey…☆751Apr 13, 2026Updated 2 months ago
- [CVPR 2024] Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners☆155Jul 6, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [ICLR 2024 Spotlight] Official implementation of ScaleCrafter for higher-resolution visual generation at inference time.☆507Mar 7, 2024Updated 2 years ago
- A reading list of video generation☆721Jun 22, 2026Updated 2 weeks ago
- [CSUR] A Survey on Video Diffusion Models☆2,300Jun 22, 2026Updated 2 weeks ago
- 🔥🔥🔥A curated list of papers on recent diffusion-based high-resolution image and video synthesis works.☆169Dec 26, 2024Updated last year
- LVDM: Latent Video Diffusion Models for High-Fidelity Long Video Generation☆504Nov 16, 2024Updated last year
- A collection of awesome video generation studies.☆773Mar 31, 2026Updated 3 months ago
- a collection of awesome autoregressive visual generation models☆82Apr 17, 2025Updated last year
- Official repository of IDEA-Bench☆41Jan 24, 2025Updated last year
- This repo contains the code for 1D tokenizer and generator☆1,165Mar 20, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- [ICCV 2025] Prompt-A-Video☆24Feb 2, 2025Updated last year
- [Neurips 2025 NextVid Workshop Oral✨] Official Implementation of VideoGen-of-Thought: Step-by-step generating multi-shot video with minim…☆62Sep 22, 2025Updated 9 months ago
- SEED-Voken: A Series of Powerful Visual Tokenizers☆1,012Nov 25, 2025Updated 7 months ago
- [NeurIPS 2025 Spotlight] A Unified Tokenizer for Visual Generation and Understanding☆526Nov 14, 2025Updated 7 months ago
- Code and Data for "GenAI Arena: An Open Evaluation Platform for Generative Models" [NeurIPS 2024]☆34Sep 8, 2024Updated last year
- [Arxiv 2025] Official PyTorch implementation of DiffMoE, TC-DiT, EC-DiT and Dense DiT☆175Oct 21, 2025Updated 8 months ago
- [CVPR 2024] Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers☆696Oct 25, 2024Updated last year
- This is a repo to track the latest autoregressive visual generation papers.☆431Jun 25, 2025Updated last year
- [Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey☆477Jan 17, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- [ACM Multimedia 2025 Datasets Track] EditWorld: Simulating World Dynamics for Instruction-Following Image Editing☆141Aug 2, 2025Updated 11 months ago
- [TMLR 2025🔥] A survey for the autoregressive models in vision.☆802May 5, 2026Updated 2 months ago
- collection of diffusion model papers categorized by their subareas☆2,215Mar 16, 2026Updated 3 months ago
- Latest Advances on Multimodal Large Language Models☆17,921Jul 2, 2026Updated last week
- A collection of resources on controllable generation with text-to-image diffusion models.☆1,112Dec 31, 2024Updated last year
- LaVIT: Empower the Large Language Model to Understand and Generate Visual Content☆603Oct 6, 2024Updated last year
- Official implementation of the paper "Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Vi…☆252Mar 19, 2025Updated last year