zjysteven / lmms-finetuneView external linksLinks
A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision, llama-3.2-vision, qwen-vl, qwen2-vl, phi3-v etc.
☆364Dec 11, 2025Updated 2 months ago
Alternatives and similar repositories for lmms-finetune
Users that are interested in lmms-finetune are comparing it to the libraries listed below
Sorting:
- A Framework of Small-scale Large Multimodal Models☆960Feb 7, 2026Updated last week
- ☆4,562Sep 14, 2025Updated 5 months ago
- 【NeurIPS 2024】Dense Connector for MLLMs☆180Oct 14, 2024Updated last year
- ☆385Feb 8, 2025Updated last year
- An open-source implementation for training LLaVA-NeXT.☆431Oct 23, 2024Updated last year
- Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3, Qwen3-MoE, DeepSeek-R1, GLM4.5, InternLM3, Llama4, ...) and 300+ MLLMs (…☆12,670Updated this week
- 🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)☆848Aug 5, 2025Updated 6 months ago
- When do we not need larger vision models?☆412Feb 8, 2025Updated last year
- One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks☆3,684Updated this week
- [CVPR 2025] LamRA: Large Multimodal Model as Your Advanced Retrieval Assistant☆176Jul 7, 2025Updated 7 months ago
- Official repository for the paper PLLaVA☆676Jul 28, 2024Updated last year
- [CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型☆9,806Sep 22, 2025Updated 4 months ago
- Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks☆3,816Updated this week
- [ICCV 2025] LLaVA-CoT, a visual language model capable of spontaneous, systematic reasoning☆2,125Dec 12, 2025Updated 2 months ago
- A Next-Generation Training Engine Built for Ultra-Large MoE Models☆5,085Updated this week
- Visualizing the attention of vision-language models☆280Feb 28, 2025Updated 11 months ago
- ☆11Jan 8, 2025Updated last year
- A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.☆1,430Updated this week
- [ICML 2025] Official PyTorch implementation of LongVU☆422May 8, 2025Updated 9 months ago
- Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];☆40Jan 4, 2024Updated 2 years ago
- Aligning LMMs with Factually Augmented RLHF☆392Nov 1, 2023Updated 2 years ago
- A fork to add multimodal model training to open-r1☆1,474Feb 8, 2025Updated last year
- An open-source implementaion for fine-tuning Qwen-VL series by Alibaba Cloud.☆1,658Jan 10, 2026Updated last month
- [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.☆24,446Aug 12, 2024Updated last year
- Cambrian-1 is a family of multimodal LLMs with a vision-centric design.☆1,986Nov 7, 2025Updated 3 months ago
- ☆189Feb 5, 2026Updated last week
- LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models☆164Sep 27, 2025Updated 4 months ago
- InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions☆2,919May 26, 2025Updated 8 months ago
- VILA is a family of state-of-the-art vision language models (VLMs) for diverse multimodal AI tasks across the edge, data center, and clou…☆3,754Nov 28, 2025Updated 2 months ago
- Latest Advances on Multimodal Large Language Models☆17,337Feb 7, 2026Updated last week
- Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model☆281Jun 25, 2024Updated last year
- ☆16Apr 23, 2025Updated 9 months ago
- ☆13Jul 30, 2024Updated last year
- ☆41Aug 26, 2025Updated 5 months ago
- ☆13Feb 25, 2025Updated 11 months ago
- A RLHF Infrastructure for Vision-Language Models☆196Nov 15, 2024Updated last year
- [NeurIPS 2025 🔥] FakeVLM: Advancing Synthetic Image Detection through Explainable Multimodal Models and Fine-Grained Artifact Analysis☆118Sep 24, 2025Updated 4 months ago
- Official repository for paper MG-LLaVA: Towards Multi-Granularity Visual Instruction Tuning(https://arxiv.org/abs/2406.17770).☆159Sep 27, 2024Updated last year
- Official code for Paper "Mantis: Multi-Image Instruction Tuning" [TMLR 2024 Best Paper]☆239Jan 3, 2026Updated last month