LMM101 / Awesome-Multimodal-Next-Token-PredictionLinks
[Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey
β445Updated 5 months ago
Alternatives and similar repositories for Awesome-Multimodal-Next-Token-Prediction
Users that are interested in Awesome-Multimodal-Next-Token-Prediction are comparing it to the libraries listed below
Sorting:
- Video-R1: Reinforcing Video Reasoning in MLLMs [π₯the first paper to explore R1 for video]β577Updated 3 weeks ago
- Official implementation of UnifiedReward & UnifiedReward-Thinkβ429Updated last week
- β547Updated this week
- Explore the Multimodal βAha Momentβ on 2B Modelβ594Updated 3 months ago
- π This is a repository for organizing papers, codes and other resources related to unified multimodal models.β588Updated this week
- [ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationβ348Updated 2 months ago
- MM-Eureka V0 also called R1-Multimodal-Journey, Latest version is in MM-Eurekaβ307Updated this week
- MM-EUREKA: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learningβ665Updated 3 weeks ago
- β¨First Open-Source R1-like Video-LLM [2025/02/18]β348Updated 4 months ago
- Multimodal Chain-of-Thought Reasoning: A Comprehensive Surveyβ663Updated this week
- This is the first paper to explore how to effectively use RL for MLLMs and introduce Vision-R1, a reasoning MLLM that leverages cold-staβ¦β613Updated last week
- [Neurips'24 Spotlight] Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought β¦β331Updated 6 months ago
- [CVPR 2025] π₯ Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".β337Updated 3 months ago
- This repository provides valuable reference for researchers in the field of multimodality, please start your exploratory travel in RL-basβ¦β922Updated last week
- Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Modelsβ445Updated 2 weeks ago
- π This is a repository for organizing papers, codes, and other resources related to unified multimodal models.β246Updated this week
- Efficient Multimodal Large Language Models: A Surveyβ356Updated last month
- Official repo and evaluation implementation of VSI-Benchβ512Updated 3 months ago
- Open-Qwen2VL: Compute-Efficient Pre-Training of Fully-Open Multimodal LLMs on Academic Resourcesβ229Updated last month
- Project Page For "Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcement"β424Updated 2 weeks ago
- R1-onevision, a visual language model capable of deep CoT reasoning.β528Updated 2 months ago
- EVE Series: Encoder-Free Vision-Language Models from BAAIβ332Updated 3 months ago
- Pytorch implementation for the paper titled "SimpleAR: Pushing the Frontier of Autoregressive Visual Generation"β371Updated this week
- [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creationβ448Updated 6 months ago
- A paper list of some recent works about Token Compress for Vit and VLMβ521Updated last week
- Resources and paper list for "Thinking with Images for LVLMs". This repository accompanies our survey on how LVLMs can leverage visual inβ¦β358Updated this week
- A fork to add multimodal model training to open-r1β1,309Updated 4 months ago
- [TMLR 2025π₯] A survey for the autoregressive models in vision.β638Updated this week
- Extend OpenRLHF to support LMM RL training for reproduction of DeepSeek-R1 on multimodal tasks.β776Updated last month
- β338Updated last year