LMM101 / Awesome-Multimodal-Next-Token-PredictionLinks
[Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey
β447Updated 7 months ago
Alternatives and similar repositories for Awesome-Multimodal-Next-Token-Prediction
Users that are interested in Awesome-Multimodal-Next-Token-Prediction are comparing it to the libraries listed below
Sorting:
- π This is a repository for organizing papers, codes and other resources related to unified multimodal models.β681Updated last month
- Official implementation of UnifiedReward & UnifiedReward-Thinkβ531Updated last week
- Video-R1: Reinforcing Video Reasoning in MLLMs [π₯the first paper to explore R1 for video]β685Updated last week
- β804Updated last week
- Explore the Multimodal βAha Momentβ on 2B Modelβ607Updated 5 months ago
- MM-Eureka V0 also called R1-Multimodal-Journey, Latest version is in MM-Eurekaβ317Updated 2 months ago
- [CVPR 2025] π₯ Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".β379Updated last month
- Awesome Unified Multimodal Modelsβ671Updated 3 weeks ago
- This is the first paper to explore how to effectively use R1-like RL for MLLMs and introduce Vision-R1, a reasoning MLLM that leverages β¦β688Updated this week
- Long-RL: Scaling RL to Long Sequencesβ605Updated last week
- β¨First Open-Source R1-like Video-LLM [2025/02/18]β362Updated 6 months ago
- MM-EUREKA: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learningβ733Updated last week
- [ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationβ383Updated 4 months ago
- Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Modelsβ628Updated 3 weeks ago
- π This is a repository for organizing papers, codes, and other resources related to unified multimodal models.β288Updated last week
- [Preprint] On the Generalization of SFT: A Reinforcement Learning Perspective with Reward Rectification.β435Updated 3 weeks ago
- Multimodal Chain-of-Thought Reasoning: A Comprehensive Surveyβ801Updated 2 weeks ago
- Extend OpenRLHF to support LMM RL training for reproduction of DeepSeek-R1 on multimodal tasks.β818Updated 4 months ago
- [COLM 2025] Open-Qwen2VL: Compute-Efficient Pre-Training of Fully-Open Multimodal LLMs on Academic Resourcesβ263Updated 3 weeks ago
- Resources and paper list for "Thinking with Images for LVLMs". This repository accompanies our survey on how LVLMs can leverage visual inβ¦β911Updated 2 weeks ago
- EVE Series: Encoder-Free Vision-Language Models from BAAIβ349Updated last month
- π₯π₯π₯ A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).β507Updated 5 months ago
- R1-onevision, a visual language model capable of deep CoT reasoning.β565Updated 5 months ago
- β615Updated last week
- A Unified Tokenizer for Visual Generation and Understandingβ396Updated last month
- [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creationβ456Updated 9 months ago
- The Next Step Forward in Multimodal LLM Alignmentβ178Updated 4 months ago
- [Neurips'24 Spotlight] Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought β¦β370Updated 8 months ago
- Code for MetaMorph Multimodal Understanding and Generation via Instruction Tuningβ209Updated 4 months ago
- Efficient Multimodal Large Language Models: A Surveyβ371Updated 4 months ago