Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Models
☆1,127May 19, 2026Updated last week
Alternatives and similar repositories for Awesome-Multimodal-Large-Language-Models
Users that are interested in Awesome-Multimodal-Large-Language-Models are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Latest Advances on Multimodal Large Language Models☆17,829May 1, 2026Updated 3 weeks ago
- ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models☆164Dec 26, 2024Updated last year
- This repository provides valuable reference for researchers in the field of multimodality, please start your exploratory travel in RL-bas…☆1,412May 11, 2026Updated 2 weeks ago
- The Next Step Forward in Multimodal LLM Alignment☆199May 1, 2025Updated last year
- A fork to add multimodal model training to open-r1☆1,548Feb 8, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Resources and paper list for "Thinking with Images for LVLMs". This repository accompanies our survey on how LVLMs can leverage visual in…☆1,466Mar 9, 2026Updated 2 months ago
- Latest open-source "Thinking with images" (O3/O4-mini) papers, covering training-free, SFT-based, and RL-enhanced methods for "fine-grain…☆113Aug 21, 2025Updated 9 months ago
- Extend OpenRLHF to support LMM RL training for reproduction of DeepSeek-R1 on multimodal tasks.☆843May 14, 2025Updated last year
- MM-EUREKA: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning☆773Sep 7, 2025Updated 8 months ago
- EasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRL☆4,950Apr 6, 2026Updated last month
- Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks☆4,145May 15, 2026Updated 2 weeks ago
- ☆4,667Apr 15, 2026Updated last month
- Official repository of 'Visual-RFT: Visual Reinforcement Fine-Tuning' & 'Visual-ARFT: Visual Agentic Reinforcement Fine-Tuning'’☆2,241Oct 29, 2025Updated 7 months ago
- Solve Visual Understanding with Reinforced VLMs☆5,959Mar 12, 2026Updated 2 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- [CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型☆10,038Sep 22, 2025Updated 8 months ago
- Witness the aha moment of VLM with less than $3.☆4,057May 19, 2025Updated last year
- 📖 A curated list of resources dedicated to hallucination of multimodal large language models (MLLM).☆1,020Sep 27, 2025Updated 8 months ago
- ✨✨ [ICLR 2026] MME-Unify: A Comprehensive Benchmark for Unified Multimodal Understanding and Generation Models☆43Apr 10, 2025Updated last year
- An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Asy…☆9,548Updated this week
- Reproduce R1 Zero on Logic Puzzle☆2,450Mar 20, 2025Updated last year
- [ICLR2026] This is the first paper to explore how to effectively use R1-like RL for MLLMs and introduce Vision-R1, a reasoning MLLM that…☆1,082Mar 20, 2026Updated 2 months ago
- ✨✨ [ICLR 2025] MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?☆157Oct 21, 2025Updated 7 months ago
- Latest Advances on System-2 Reasoning☆1,352Jun 8, 2025Updated 11 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- The development and future prospects of large multimodal reasoning models.☆610Jan 9, 2026Updated 4 months ago
- A paper list of some recent works about Token Compress for Vit and VLM☆909Updated this week
- ☆1,215Nov 20, 2025Updated 6 months ago
- Mix-DDPM: Enhancing Diffusion Models through Fitting Mixture Noise with Global Stochastic Offset (ACM ToMM 2024)☆12Jul 23, 2024Updated last year
- 📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.☆824Oct 10, 2025Updated 7 months ago
- [ICLR & NeurIPS 2025] Repository for Show-o series, One Single Transformer to Unify Multimodal Understanding and Generation.☆1,933Jan 8, 2026Updated 4 months ago
- verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework☆21,514Updated this week
- [ICLR 2025 Spotlight] OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text☆421May 5, 2025Updated last year
- Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey☆1,004May 22, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [ACM Multimedia 2025] This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual…☆83Feb 22, 2025Updated last year
- [Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey☆477Jan 17, 2025Updated last year
- Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-R1, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL…☆14,218May 22, 2026Updated last week
- MM-Eureka V0 also called R1-Multimodal-Journey, Latest version is in MM-Eureka☆324Jun 21, 2025Updated 11 months ago
- R1-onevision, a visual language model capable of deep CoT reasoning.☆580Apr 13, 2025Updated last year
- A collection of LLM papers, blogs, and projects, with a focus on OpenAI o1 🍓 and reasoning techniques.☆6,897Dec 17, 2025Updated 5 months ago
- [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.☆24,829Aug 12, 2024Updated last year