LMM101 / Awesome-Multimodal-Next-Token-PredictionLinks
[Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey
β447Updated 7 months ago
Alternatives and similar repositories for Awesome-Multimodal-Next-Token-Prediction
Users that are interested in Awesome-Multimodal-Next-Token-Prediction are comparing it to the libraries listed below
Sorting:
- Official implementation of UnifiedReward & UnifiedReward-Thinkβ511Updated 3 weeks ago
- π This is a repository for organizing papers, codes and other resources related to unified multimodal models.β670Updated 3 weeks ago
- β755Updated last month
- Video-R1: Reinforcing Video Reasoning in MLLMs [π₯the first paper to explore R1 for video]β667Updated 3 weeks ago
- [CVPR 2025] π₯ Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".β371Updated 2 weeks ago
- Explore the Multimodal βAha Momentβ on 2B Modelβ607Updated 5 months ago
- [ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationβ382Updated 4 months ago
- β¨First Open-Source R1-like Video-LLM [2025/02/18]β357Updated 6 months ago
- MM-Eureka V0 also called R1-Multimodal-Journey, Latest version is in MM-Eurekaβ317Updated 2 months ago
- Awesome Unified Multimodal Modelsβ597Updated last week
- π This is a repository for organizing papers, codes, and other resources related to unified multimodal models.β277Updated 2 weeks ago
- Long-RL: Scaling RL to Long Sequencesβ592Updated this week
- β513Updated last month
- This is the first paper to explore how to effectively use RL for MLLMs and introduce Vision-R1, a reasoning MLLM that leverages cold-staβ¦β672Updated last month
- Multimodal Chain-of-Thought Reasoning: A Comprehensive Surveyβ764Updated last month
- π₯π₯π₯ A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).β498Updated 4 months ago
- [COLM 2025] Open-Qwen2VL: Compute-Efficient Pre-Training of Fully-Open Multimodal LLMs on Academic Resourcesβ251Updated 3 months ago
- MM-EUREKA: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learningβ725Updated 3 weeks ago
- Efficient Multimodal Large Language Models: A Surveyβ367Updated 3 months ago
- Resources and paper list for "Thinking with Images for LVLMs". This repository accompanies our survey on how LVLMs can leverage visual inβ¦β852Updated last week
- Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Modelsβ576Updated this week
- Extend OpenRLHF to support LMM RL training for reproduction of DeepSeek-R1 on multimodal tasks.β812Updated 3 months ago
- R1-onevision, a visual language model capable of deep CoT reasoning.β557Updated 4 months ago
- EVE Series: Encoder-Free Vision-Language Models from BAAIβ345Updated last month
- The Next Step Forward in Multimodal LLM Alignmentβ175Updated 3 months ago
- [TMLR 2025π₯] A survey for the autoregressive models in vision.β683Updated this week
- [ECCV 2024 Oral] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Languaβ¦β475Updated 7 months ago
- [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creationβ455Updated 8 months ago
- [NeurIPS 2023 Datasets and Benchmarks Track] LAMM: Multi-Modal Large Language Models and Applications as AI Agentsβ317Updated last year
- [Preprint] On the Generalization of SFT: A Reinforcement Learning Perspective with Reward Rectification.β361Updated last week