Coobiw / MPP-LLaVA
Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conversations}. Don't let the poverty limit your imagination! Train your own 8B/14B LLaVA-training-like MLLM on RTX3090/4090 24GB.
☆381Updated last month
Related projects ⓘ
Alternatives and complementary repositories for MPP-LLaVA
- 欢迎来到 LLM-Dojo，这里是一个开源大模型学习场所，使用简洁且易阅读的代码构建模型训练框架(支持各种主流模型如Qwen、Llama、GLM等等)、RLHF框架(DPO/CPO/KTO/PPO)等各种功能。👩🎓👨🎓☆350Updated 2 weeks ago
- Efficient Multimodal Large Language Models: A Survey☆280Updated 3 months ago
- Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Models☆154Updated 2 weeks ago
- 欢迎来到 "LLM-travel" 仓库！探索大语言模型（LLM）的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。☆269Updated 4 months ago
- 主要记录大语言大模型（LLMs） 算法（应用）工程师多模态相关知识☆89Updated 6 months ago
- Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Pre-training Dataset and Benchmarks☆284Updated 10 months ago
- [NeurIPS 2024] BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models☆215Updated this week
- 支持中英文双语视觉-文本对话的开源可商用多模态模型。☆353Updated last year
- X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages☆306Updated last year
- DeepSpeed教程 & 示例注释 & 学习笔记 （大模型高效训练）☆118Updated last year
- ☆223Updated 8 months ago
- This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.☆356Updated 7 months ago
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆231Updated 6 months ago
- [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback☆236Updated 2 months ago
- Train a 1B LLM with 1T tokens from scratch by personal☆347Updated last week
- 开源SFT数据集整理,随时补充☆447Updated last year
- OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text☆274Updated last week
- RLAIF-V: Aligning MLLMs through Open-Source AI Feedback for Super GPT-4V Trustworthiness☆246Updated 2 weeks ago
- [MIR-2023-Survey] A continuously updated paper list for multi-modal pre-trained big models☆279Updated 3 weeks ago
- 个人项目地址，一些大语言模型和多模态模型的应用☆123Updated 2 weeks ago
- FlagEval is an evaluation toolkit for AI large foundation models.☆302Updated 4 months ago
- [ICLR'24 spotlight] Chinese and English Multimodal Large Model Series (Chat and Paint) | 基于CPM基础模型的中英双语多模态大模型系列☆1,092Updated 5 months ago
- [NeurIPS 2023 Datasets and Benchmarks Track] LAMM: Multi-Modal Large Language Models and Applications as AI Agents☆302Updated 7 months ago
- LLMs interview notes and answers:该仓库主要记录大模型（LLMs）算法工程师相关的面试题和参考答案☆354Updated last year
- Align Anything: Training All-modality Model with Feedback☆250Updated this week
- Cool Papers - Immersive Paper Discovery☆407Updated this week
- TaiSu（太素）--a large-scale Chinese multimodal dataset（亿级大规模中文视觉语言预训练数据集）☆175Updated last year
- 从预训练到强化学习的中文llama2☆94Updated last year
- Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model☆246Updated 4 months ago
- 多模态 MM +Chat 合集☆209Updated 2 weeks ago