Alternatives and similar repositories for LearnDeepSpeed

Users that are interested in LearnDeepSpeed are comparing it to the libraries listed below

• wdndev / mllm_interview_note
  主要记录大语言大模型（LLMs） 算法（应用）工程师多模态相关知识
  ☆250Updated last year
• xxcheng0708 / pytorch-model-train-template
  pytorch单精度、半精度、混合精度、单卡、多卡（DP / DDP）、FSDP、DeepSpeed模型训练代码，并对比不同方法的训练速度以及GPU内存的使用
  ☆123Updated last year
• AI-Study-Han / Zero-Qwen-VL
  训练一个对中文支持更好的LLaVA模型，并开源训练代码和数据。
  ☆76Updated last year
• step-law / steplaw
  ☆205Updated 2 weeks ago
• Glanvery / LLM-Travel
  欢迎来到 "LLM-travel" 仓库！探索大语言模型（LLM）的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。
  ☆351Updated last year
• Victorwz / Open-Qwen2VL
  [COLM 2025] Open-Qwen2VL: Compute-Efficient Pre-Training of Fully-Open Multimodal LLMs on Academic Resources
  ☆281Updated 2 months ago
• GAIR-NLP / MAYE
  Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme
  ☆144Updated 7 months ago
• OvJat / DeepSpeedTutorial
  DeepSpeed Tutorial
  ☆102Updated last year
• yfzhang114 / Awesome-Multimodal-Large-Language-Models
  Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Models
  ☆730Updated last week
• yuanzhoulvpi2017 / vscode_debug_transformers
  ☆396Updated 9 months ago
• yongliang-wu / DFT
  [Preprint] On the Generalization of SFT: A Reinforcement Learning Perspective with Reward Rectification.
  ☆495Updated last week
• Ablustrund / LoRAMoE
  LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment
  ☆382Updated last year
• liujunwen23 / MIRE
  WWW2025 Multimodal Intent Recognition for Dialogue Systems Challenge
  ☆127Updated last year
• chunhuizhang / llm_rl
  llm & rl
  ☆243Updated 3 weeks ago
• datawhalechina / sora-tutorial
  ☆103Updated last year
• qingkelab / qingketalk
  青稞Talk
  ☆160Updated last week
• firechecking / CleanTransformer
  an implementation of transformer, bert, gpt, and diffusion models for learning purposes
  ☆159Updated last year
• RethinkFun / trian_ppo
  ☆124Updated last year
• swordlidev / Efficient-Multimodal-LLMs-Survey
  Efficient Multimodal Large Language Models: A Survey
  ☆376Updated 6 months ago
• yang19527 / AwesomeInterview
  包含程序员面试大厂面试题和面试经验
  ☆193Updated 5 months ago
• OpenRLHF / OpenRLHF-M
  An Easy-to-use, Scalable and High-performance RLHF Framework designed for Multimodal Models.
  ☆146Updated last month
• suu990901 / LLaMA-MiLe-Loss
  Code for a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models
  ☆65Updated 8 months ago
• hengjiUSTC / learn-llm
  ☆115Updated last year
• hhaAndroid / awesome-mm-chat
  多模态 MM +Chat 合集
  ☆278Updated 2 months ago
• liangyuwang / zo2
  ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory [COLM2025]
  ☆194Updated 4 months ago
• Outsider565 / LoRA-GA
  ☆213Updated last year
• chunhuizhang / pytorch_distribute_tutorials
  pytorch distribute tutorials
  ☆156Updated 5 months ago
• zhanshijinwat / Steel-LLM
  Train a 1B LLM with 1T tokens from scratch by personal
  ☆751Updated 6 months ago
• HarderThenHarder / RLLoggingBoard
  A visuailzation tool to make deep understaning and easier debugging for RLHF training.
  ☆264Updated 8 months ago
• Visual-Agent / DeepEyes
  ☆971Updated 3 weeks ago