LMM101 / Awesome-Multimodal-Next-Token-PredictionLinks
[Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey
β446Updated 5 months ago
Alternatives and similar repositories for Awesome-Multimodal-Next-Token-Prediction
Users that are interested in Awesome-Multimodal-Next-Token-Prediction are comparing it to the libraries listed below
Sorting:
- π This is a repository for organizing papers, codes and other resources related to unified multimodal models.β613Updated 2 weeks ago
- Official implementation of UnifiedReward & UnifiedReward-Thinkβ457Updated last week
- β629Updated last week
- Video-R1: Reinforcing Video Reasoning in MLLMs [π₯the first paper to explore R1 for video]β609Updated last month
- [ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationβ362Updated 2 months ago
- β¨First Open-Source R1-like Video-LLM [2025/02/18]β350Updated 4 months ago
- π This is a repository for organizing papers, codes, and other resources related to unified multimodal models.β256Updated 3 weeks ago
- [CVPR 2025] π₯ Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".β351Updated this week
- Resources and paper list for "Thinking with Images for LVLMs". This repository accompanies our survey on how LVLMs can leverage visual inβ¦β660Updated last week
- Explore the Multimodal βAha Momentβ on 2B Modelβ596Updated 3 months ago
- This is the first paper to explore how to effectively use RL for MLLMs and introduce Vision-R1, a reasoning MLLM that leverages cold-staβ¦β637Updated 2 weeks ago
- π₯π₯π₯ A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).β483Updated 3 months ago
- MM-Eureka V0 also called R1-Multimodal-Journey, Latest version is in MM-Eurekaβ312Updated 3 weeks ago
- Multimodal Chain-of-Thought Reasoning: A Comprehensive Surveyβ695Updated 2 weeks ago
- Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Modelsβ493Updated this week
- β437Updated last week
- [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creationβ450Updated 7 months ago
- Efficient Multimodal Large Language Models: A Surveyβ361Updated 2 months ago
- MM-EUREKA: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learningβ696Updated 3 weeks ago
- Awesome Unified Multimodal Modelsβ414Updated 2 weeks ago
- EVE Series: Encoder-Free Vision-Language Models from BAAIβ333Updated last week
- [ECCV 2024 Oral] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Languaβ¦β451Updated 6 months ago
- The Next Step Forward in Multimodal LLM Alignmentβ169Updated 2 months ago
- LaVIT: Empower the Large Language Model to Understand and Generate Visual Contentβ583Updated 9 months ago
- [TMLR 2025π₯] A survey for the autoregressive models in vision.β648Updated last week
- Long Context Transfer from Language to Visionβ384Updated 3 months ago
- [Neurips'24 Spotlight] Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought β¦β342Updated 6 months ago
- Code for MetaMorph Multimodal Understanding and Generation via Instruction Tuningβ193Updated 2 months ago
- Official repository for VisionZip (CVPR 2025)β319Updated last month
- [ICLR 2025 Spotlight] OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Textβ374Updated 2 months ago