Coobiw / MPP-LLaVA
Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conversations}. Don't let the poverty limit your imagination! Train your own 8B/14B LLaVA-training-like MLLM on RTX3090/4090 24GB.
☆440Updated last month
Alternatives and similar repositories for MPP-LLaVA:
Users that are interested in MPP-LLaVA are comparing it to the libraries listed below
- Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Models☆382Updated 2 weeks ago
- minimal-cost for training 0.5B R1-Zero☆706Updated this week
- 欢迎来到 LLM-Dojo，这里是一个开源大模型学习场所，使用简洁且易阅读的代码构建模型训练框架(支持各种主流模型如Qwen、Llama、GLM等等)、RLHF框架(DPO/CPO/KTO/PPO)等各种功能。👩🎓👨🎓☆700Updated last week
- 主要记录大语言大模型（LLMs） 算法（应用）工程师多模态相关知识☆180Updated 11 months ago
- This is the first paper to explore how to effectively use RL for MLLMs and introduce Vision-R1, a reasoning MLLM that leverages cold-sta…☆527Updated last week
- Efficient Multimodal Large Language Models: A Survey☆337Updated last month
- DeepSpeed教程 & 示例注释 & 学习笔记 （大模型高效训练）☆159Updated last year
- A jounery to real multimodel R1 ! We are doing on large-scale experiment☆295Updated last month
- 多模态 MM +Chat 合集☆255Updated 2 months ago
- This repository provides valuable reference for researchers in the field of multimodality, please start your exploratory travel in RL-bas…☆663Updated this week
- Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey☆507Updated this week
- ☆312Updated 2 months ago
- [ICLR 2025 Spotlight] OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text☆340Updated last month
- Repo for Benchmarking Multimodal Retrieval Augmented Generation with Dynamic VQA Dataset and Self-adaptive Planning Agent☆305Updated this week
- This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.☆424Updated 3 weeks ago
- MM-EUREKA: Exploring Visual Aha Moment with Rule-based Large-scale Reinforcement Learning☆574Updated this week
- [CVPR 2024 Highlight] OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allo…☆332Updated 8 months ago
- ✨First Open-Source R1-like Video-LLM [2025/02/18]☆325Updated 2 months ago
- [NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models☆252Updated last month
- A paper list of some recent works about Token Compress for Vit and VLM☆430Updated last week
- 训练一个对中文支持更好的LLaVA模型，并开源训练代码和数据。☆54Updated 7 months ago
- [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback☆276Updated 7 months ago
- Explore the Multimodal “Aha Moment” on 2B Model☆577Updated last month
- 欢迎来到 "LLM-travel" 仓库！探索大语言模型（LLM）的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。☆316Updated 9 months ago
- MegaPairs: Massive Data Synthesis For Universal Multimodal Retrieval☆155Updated last week
- [NeurIPS 2023 Datasets and Benchmarks Track] LAMM: Multi-Modal Large Language Models and Applications as AI Agents☆311Updated last year
- LLMs interview notes and answers:该仓库主要记录大模型（LLMs）算法工程师相关的面试题和参考答案☆521Updated last year
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆323Updated 11 months ago
- 支持中英文双语视觉-文本对话的开源可商用多模态模型。☆370Updated last year
- Train a 1B LLM with 1T tokens from scratch by personal☆613Updated last month