LMM101 / Awesome-Multimodal-Next-Token-PredictionLinks
[Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey
☆443Updated 4 months ago
Alternatives and similar repositories for Awesome-Multimodal-Next-Token-Prediction
Users that are interested in Awesome-Multimodal-Next-Token-Prediction are comparing it to the libraries listed below
Sorting:
- 📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.☆557Updated last month
- Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey☆613Updated 2 weeks ago
- Video-R1: Reinforcing Video Reasoning in MLLMs [🔥the first paper to explore R1 for video]☆546Updated last week
- [ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation☆330Updated last month
- MM-EUREKA: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning☆631Updated last week
- This is the first paper to explore how to effectively use RL for MLLMs and introduce Vision-R1, a reasoning MLLM that leverages cold-sta…☆579Updated 3 weeks ago
- ✨First Open-Source R1-like Video-LLM [2025/02/18]☆342Updated 3 months ago
- [CVPR 2025] 🔥 Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".☆330Updated 3 months ago
- [TMLR 2025🔥] A survey for the autoregressive models in vision.☆626Updated this week
- Explore the Multimodal “Aha Moment” on 2B Model☆589Updated 2 months ago
- This repository provides valuable reference for researchers in the field of multimodality, please start your exploratory travel in RL-bas…☆820Updated this week
- Official repo and evaluation implementation of VSI-Bench☆492Updated 3 months ago
- Official implementation of UnifiedReward & UnifiedReward-Think☆390Updated last week
- Awesome Unified Multimodal Models☆265Updated 2 weeks ago
- 📖 This is a repository for organizing papers, codes, and other resources related to unified multimodal models.☆218Updated this week
- A jounery to real multimodel R1 ! We are doing on large-scale experiment☆305Updated 3 weeks ago
- [ECCV 2024 Oral] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Langua…☆430Updated 5 months ago
- EVE Series: Encoder-Free Vision-Language Models from BAAI☆327Updated 3 months ago
- [Neurips'24 Spotlight] Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought …☆323Updated 5 months ago
- Extend OpenRLHF to support LMM RL training for reproduction of DeepSeek-R1 on multimodal tasks.☆760Updated 3 weeks ago
- ☆269Updated last week
- Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Models☆436Updated 3 weeks ago
- Efficient Multimodal Large Language Models: A Survey☆350Updated last month
- A fork to add multimodal model training to open-r1☆1,281Updated 3 months ago
- SEED-Voken: A Series of Powerful Visual Tokenizers☆885Updated 3 months ago
- Pytorch implementation for the paper titled "SimpleAR: Pushing the Frontier of Autoregressive Visual Generation"☆358Updated last month
- ☆334Updated last year
- [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation☆443Updated 6 months ago
- ✨✨R1-Reward: Training Multimodal Reward Model Through Stable Reinforcement Learning☆136Updated 3 weeks ago
- 🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).☆477Updated 2 months ago