showlab / Awesome-Unified-Multimodal-Models
π This is a repository for organizing papers, codes and other resources related to unified multimodal models.
β506Updated 2 weeks ago
Alternatives and similar repositories for Awesome-Unified-Multimodal-Models:
Users that are interested in Awesome-Unified-Multimodal-Models are comparing it to the libraries listed below
- [TMLR 2025π₯] A survey for the autoregressive models in vision.β508Updated this week
- [CVPR 2025] π₯ Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".β316Updated last month
- MM-EUREKA: Exploring Visual Aha Moment with Rule-based Large-scale Reinforcement Learningβ574Updated this week
- [Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Surveyβ419Updated 3 months ago
- π₯π₯π₯ A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).β461Updated 3 weeks ago
- π This is a repository for organizing papers, codes, and other resources related to unified multimodal models.β173Updated 2 weeks ago
- [ICLR 2025] Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.β1,350Updated 3 weeks ago
- Video-R1: Reinforcing Video Reasoning in MLLMs [π₯the first paper to explore R1 for video]β469Updated this week
- This is a repo to track the latest autoregressive visual generation papers.β272Updated last week
- Official implementation of Unified Reward Model for Multimodal Understanding and Generation.β242Updated this week
- This repository provides valuable reference for researchers in the field of multimodality, please start your exploratory travel in RL-basβ¦β663Updated this week
- Multimodal Chain-of-Thought Reasoning: A Comprehensive Surveyβ507Updated this week
- [Neurips'24 Spotlight] Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought β¦β298Updated 4 months ago
- β¨First Open-Source R1-like Video-LLM [2025/02/18]β325Updated 2 months ago
- This is the first paper to explore how to effectively use RL for MLLMs and introduce Vision-R1, a reasoning MLLM that leverages cold-staβ¦β527Updated last week
- SEED-Voken: A Series of Powerful Visual Tokenizersβ868Updated 2 months ago
- This repo contains the code for 1D tokenizer and generatorβ838Updated last month
- EVE Series: Encoder-Free Vision-Language Models from BAAIβ322Updated last month
- [ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationβ299Updated this week
- A paper list of some recent works about Token Compress for Vit and VLMβ430Updated last week
- β327Updated last year
- [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creationβ434Updated 4 months ago
- Official repository of "GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing"β230Updated last month
- Official repository for VisionZip (CVPR 2025)β269Updated last month
- Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Modelsβ382Updated 2 weeks ago
- Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAIβ1,061Updated last month
- A list of works on evaluation of visual generation models, including evaluation metrics, models, and systemsβ282Updated this week
- Explore the Multimodal βAha Momentβ on 2B Modelβ577Updated last month
- β¨β¨[CVPR 2025] Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysisβ528Updated last week
- A jounery to real multimodel R1 ! We are doing on large-scale experimentβ295Updated last month