Latest Advances on Multimodal Large Language Models
☆17,385Feb 23, 2026Updated last week
Alternatives and similar repositories for Awesome-Multimodal-Large-Language-Models
Users that are interested in Awesome-Multimodal-Large-Language-Models are comparing it to the libraries listed below
Sorting:
- [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.☆24,500Aug 12, 2024Updated last year
- LAVIS - A One-stop Library for Language-Vision Intelligence☆11,177Nov 18, 2024Updated last year
- ☆4,577Sep 14, 2025Updated 5 months ago
- The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.☆6,545Aug 7, 2024Updated last year
- [CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型☆9,836Sep 22, 2025Updated 5 months ago
- Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)☆67,659Updated this week
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities☆22,030Jan 23, 2026Updated last month
- Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks☆3,845Updated this week
- An open source implementation of CLIP.☆13,430Updated this week
- Qwen3-VL is the multimodal large language model series developed by Qwen team, Alibaba Cloud.☆18,505Jan 30, 2026Updated last month
- The official GitHub page for the survey paper "A Survey of Large Language Models".☆12,102Mar 11, 2025Updated 11 months ago
- CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image☆32,707Feb 18, 2026Updated 2 weeks ago
- 🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.☆20,717Updated this week
- a state-of-the-art-level open visual language model | 多模态预训练模型☆6,724May 29, 2024Updated last year
- [ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters☆5,933Mar 14, 2024Updated last year
- InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions☆2,921May 26, 2025Updated 9 months ago
- Awesome-LLM: a curated list of Large Language Model☆26,378Jul 31, 2025Updated 7 months ago
- Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)☆25,760Sep 2, 2024Updated last year
- Reading list for research topics in multimodal machine learning☆6,821Aug 20, 2024Updated last year
- mPLUG-Owl: The Powerful Multi-modal Large Language Model Family☆2,540Apr 2, 2025Updated 11 months ago
- Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.5, DeepSeek-R1, GLM4.5, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL,…☆12,820Updated this week
- Emu Series: Generative Multimodal Models from BAAI☆1,768Jan 12, 2026Updated last month
- An open-source framework for training large multimodal models.☆4,071Aug 31, 2024Updated last year
- An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & TIS & vLLM & Ray & Async RL)☆9,084Updated this week
- Fast and memory-efficient exact attention☆22,460Updated this week
- An Open-source Toolkit for LLM Development☆2,805Jan 13, 2025Updated last year
- Solve Visual Understanding with Reinforced VLMs☆5,850Oct 21, 2025Updated 4 months ago
- Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and …☆17,431Sep 5, 2024Updated last year
- Train transformer language models with reinforcement learning.☆17,523Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆71,883Updated this week
- verl: Volcano Engine Reinforcement Learning for LLMs☆19,519Updated this week
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,426Jun 2, 2025Updated 9 months ago
- The paper list of the 86-page SCIS cover paper "The Rise and Potential of Large Language Model Based Agents: A Survey" by Zhiheng Xi et a…☆8,067Sep 12, 2025Updated 5 months ago
- Cambrian-1 is a family of multimodal LLMs with a vision-centric design.☆1,986Nov 7, 2025Updated 3 months ago
- One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks☆3,750Updated this week
- 🔥🔥🔥 [IEEE TCSVT] Latest Papers, Codes and Datasets on Vid-LLMs.☆3,087Dec 20, 2025Updated 2 months ago
- Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"☆8,393May 31, 2024Updated last year
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆41,706Updated this week
- Witness the aha moment of VLM with less than $3.☆4,036May 19, 2025Updated 9 months ago