LMM101 / Awesome-Multimodal-Next-Token-Prediction
[Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey
☆419Updated 3 months ago
Alternatives and similar repositories for Awesome-Multimodal-Next-Token-Prediction:
Users that are interested in Awesome-Multimodal-Next-Token-Prediction are comparing it to the libraries listed below
- 📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.☆506Updated 2 weeks ago
- MM-EUREKA: Exploring Visual Aha Moment with Rule-based Large-scale Reinforcement Learning☆574Updated this week
- Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey☆507Updated this week
- [ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation☆299Updated this week
- This repository provides valuable reference for researchers in the field of multimodality, please start your exploratory travel in RL-bas…☆663Updated this week
- Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Models☆382Updated 2 weeks ago
- This is the first paper to explore how to effectively use RL for MLLMs and introduce Vision-R1, a reasoning MLLM that leverages cold-sta…☆527Updated last week
- Explore the Multimodal “Aha Moment” on 2B Model☆577Updated last month
- A jounery to real multimodel R1 ! We are doing on large-scale experiment☆295Updated last month
- Video-R1: Reinforcing Video Reasoning in MLLMs [🔥the first paper to explore R1 for video]☆469Updated this week
- [CVPR 2025] 🔥 Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".☆316Updated last month
- ✨First Open-Source R1-like Video-LLM [2025/02/18]☆325Updated 2 months ago
- 📖 This is a repository for organizing papers, codes, and other resources related to unified multimodal models.☆173Updated 2 weeks ago
- EVE Series: Encoder-Free Vision-Language Models from BAAI☆322Updated last month
- Efficient Multimodal Large Language Models: A Survey☆337Updated last month
- [Neurips'24 Spotlight] Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought …☆298Updated 4 months ago
- 🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).☆461Updated 3 weeks ago
- [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback☆276Updated 7 months ago
- Official implementation of Unified Reward Model for Multimodal Understanding and Generation.☆242Updated this week
- Official repo and evaluation implementation of VSI-Bench☆463Updated last month
- [TMLR 2025🔥] A survey for the autoregressive models in vision.☆508Updated this week
- R1-onevision, a visual language model capable of deep CoT reasoning.☆506Updated last week
- A paper list of some recent works about Token Compress for Vit and VLM☆430Updated last week
- Open-Qwen2VL: Compute-Efficient Pre-Training of Fully-Open Multimodal LLMs on Academic Resources☆182Updated 3 weeks ago
- Extend OpenRLHF to support LMM RL training for reproduction of DeepSeek-R1 on multimodal tasks.☆728Updated this week
- A fork to add multimodal model training to open-r1☆1,227Updated 2 months ago
- An Easy-to-use, Scalable and High-performance RLHF Framework designed for Multimodal Models.☆114Updated 2 weeks ago
- The official GitHub page for the review paper "Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision M…☆497Updated last year
- [ECCV 2024 Oral] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Langua…☆413Updated 3 months ago
- [ICLR 2025 Spotlight] OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text☆340Updated last month