LMM101 / Awesome-Multimodal-Next-Token-PredictionLinks
[Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey
β443Updated 4 months ago
Alternatives and similar repositories for Awesome-Multimodal-Next-Token-Prediction
Users that are interested in Awesome-Multimodal-Next-Token-Prediction are comparing it to the libraries listed below
Sorting:
- π This is a repository for organizing papers, codes and other resources related to unified multimodal models.β557Updated last month
- Multimodal Chain-of-Thought Reasoning: A Comprehensive Surveyβ613Updated 2 weeks ago
- Video-R1: Reinforcing Video Reasoning in MLLMs [π₯the first paper to explore R1 for video]β546Updated last week
- [ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationβ330Updated last month
- MM-EUREKA: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learningβ631Updated last week
- This is the first paper to explore how to effectively use RL for MLLMs and introduce Vision-R1, a reasoning MLLM that leverages cold-staβ¦β579Updated 3 weeks ago
- β¨First Open-Source R1-like Video-LLM [2025/02/18]β342Updated 3 months ago
- [CVPR 2025] π₯ Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".β330Updated 3 months ago
- [TMLR 2025π₯] A survey for the autoregressive models in vision.β626Updated this week
- Explore the Multimodal βAha Momentβ on 2B Modelβ589Updated 2 months ago
- This repository provides valuable reference for researchers in the field of multimodality, please start your exploratory travel in RL-basβ¦β820Updated this week
- Official repo and evaluation implementation of VSI-Benchβ492Updated 3 months ago
- Official implementation of UnifiedReward & UnifiedReward-Thinkβ390Updated last week
- Awesome Unified Multimodal Modelsβ265Updated 2 weeks ago
- π This is a repository for organizing papers, codes, and other resources related to unified multimodal models.β218Updated this week
- A jounery to real multimodel R1 ! We are doing on large-scale experimentβ305Updated 3 weeks ago
- [ECCV 2024 Oral] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Languaβ¦β430Updated 5 months ago
- EVE Series: Encoder-Free Vision-Language Models from BAAIβ327Updated 3 months ago
- [Neurips'24 Spotlight] Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought β¦β323Updated 5 months ago
- Extend OpenRLHF to support LMM RL training for reproduction of DeepSeek-R1 on multimodal tasks.β760Updated 3 weeks ago
- β269Updated last week
- Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Modelsβ436Updated 3 weeks ago
- Efficient Multimodal Large Language Models: A Surveyβ350Updated last month
- A fork to add multimodal model training to open-r1β1,281Updated 3 months ago
- SEED-Voken: A Series of Powerful Visual Tokenizersβ885Updated 3 months ago
- Pytorch implementation for the paper titled "SimpleAR: Pushing the Frontier of Autoregressive Visual Generation"β358Updated last month
- β334Updated last year
- [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creationβ443Updated 6 months ago
- β¨β¨R1-Reward: Training Multimodal Reward Model Through Stable Reinforcement Learningβ136Updated 3 weeks ago
- π₯π₯π₯ A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).β477Updated 2 months ago