bobo0810 / LearnDeepSpeed
DeepSpeed教程 & 示例注释 & 学习笔记 （大模型高效训练）
☆114Updated last year
Related projects ⓘ
Alternatives and complementary repositories for LearnDeepSpeed
- 主要记录大语言大模型（LLMs） 算法（应用）工程师多模态相关知识☆80Updated 5 months ago
- 欢迎来到 "LLM-travel" 仓库！探索大语言模型（LLM）的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。☆266Updated 3 months ago
- DeepSpeed Tutorial☆89Updated 2 months ago
- Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conv…☆376Updated last month
- an implementation of transformer, bert, gpt, and diffusion models for learning purposes☆144Updated 3 weeks ago
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆223Updated 6 months ago
- Efficient Multimodal Large Language Models: A Survey☆268Updated 2 months ago
- 包含程序员面试大厂面试题和面试经验☆98Updated 2 months ago
- Train a Chinese LLM From 0 by Personal☆197Updated last week
- 使用单个24G显卡，从0开始训练LLM☆49Updated 2 weeks ago
- Code for a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models☆53Updated 4 months ago
- This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.☆353Updated 6 months ago
- ☆99Updated 7 months ago
- pytorch单精度、半精度、混合精度、单卡、多卡（DP / DDP）、FSDP、DeepSpeed模型训练代码，并对比不同方法的训练速度以及GPU内存的使用☆75Updated 7 months ago
- 一些 LLM 方面的从零复现笔记☆134Updated last month
- Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Models☆133Updated this week
- 欢迎来到 LLM-Dojo，这里是一个开源大模型学习场所，使用简洁且易阅读的代码构建模型训练框架(支持各种主流模型如Qwen、Llama、GLM等等)、RLHF框架(DPO/CPO/KTO/PPO)等各种功能。👩🎓👨🎓☆324Updated this week
- ☆214Updated 7 months ago
- pytorch distribute tutorials☆79Updated last month
- [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback☆230Updated last month
- 个人项目地址，一些大语言模型和多模态模型的应用☆116Updated this week
- ☆149Updated 2 weeks ago
- Cool Papers - Immersive Paper Discovery☆396Updated last week
- ☆81Updated 3 months ago
- ☆87Updated 4 months ago
- Research Code for Multimodal-Cognition Team in Ant Group☆121Updated 3 months ago
- 该仓库主要记录 LLMs 算法工程师相关的顶会论文研读笔记（多模态、PEFT、小样本QA问答、RAG、LMMs可解释性、Agents、CoT）☆259Updated 7 months ago
- 训练一个对中文支持更好的LLaVA模型，并开源训练代码和数据。☆37Updated 2 months ago
- Align Anything: Training All-modality Model with Feedback☆220Updated this week
- TinyRAG☆232Updated last week