bobo0810 / LearnDeepSpeed
DeepSpeed教程 & 示例注释 & 学习笔记 （大模型高效训练）
☆118Updated last year
Related projects ⓘ
Alternatives and complementary repositories for LearnDeepSpeed
- 欢迎来到 "LLM-travel" 仓库！探索大语言模型（LLM）的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。☆269Updated 4 months ago
- 主要记录大语言大模型（LLMs） 算法（应用）工程师多模态相关知识☆89Updated 6 months ago
- an implementation of transformer, bert, gpt, and diffusion models for learning purposes☆147Updated last month
- DeepSpeed Tutorial☆90Updated 3 months ago
- 一些 LLM 方面的从零复现笔记☆139Updated 2 months ago
- 包含程序员面试大厂面试题和面试经验☆106Updated 3 months ago
- ☆223Updated 8 months ago
- ☆98Updated 8 months ago
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆231Updated 6 months ago
- ☆85Updated 2 weeks ago
- Train a 1B LLM with 1T tokens from scratch by personal☆347Updated last week
- 使用单个24G显卡，从0开始训练LLM☆49Updated last month
- Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Models☆154Updated 2 weeks ago
- pytorch distribute tutorials☆85Updated last month
- Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conv…☆381Updated last month
- The related works and background techniques about Openai o1☆144Updated 2 weeks ago
- Efficient Multimodal Large Language Models: A Survey☆280Updated 3 months ago
- This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.☆356Updated 7 months ago
- ☆51Updated last year
- LongQLoRA: Extent Context Length of LLMs Efficiently☆159Updated last year
- 训练一个对中文支持更好的LLaVA模型，并开源训练代码和数据。☆38Updated 2 months ago
- 个人项目地址，一些大语言模型和多模态模型的应用☆123Updated 2 weeks ago
- ☆155Updated last month
- Align Anything: Training All-modality Model with Feedback☆250Updated this week
- 欢迎来到 LLM-Dojo，这里是一个开源大模型学习场所，使用简洁且易阅读的代码构建模型训练框架(支持各种主流模型如Qwen、Llama、GLM等等)、RLHF框架(DPO/CPO/KTO/PPO)等各种功能。👩🎓👨🎓☆350Updated 2 weeks ago
- 该仓库主要记录 LLMs 算法工程师相关的顶会论文研读笔记（多模态、PEFT、小样本QA问答、RAG、LMMs可解释性、Agents、CoT）☆265Updated 7 months ago
- personal chatgpt☆322Updated this week
- A repository sharing the literatures about long-context large language models, including the methodologies and the evaluation benchmarks☆252Updated 3 months ago
- [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback☆236Updated 2 months ago
- WWW2025 Multimodal Intent Recognition for Dialogue Systems Challenge☆62Updated last week