Alternatives and similar repositories for LearnDeepSpeed

Users that are interested in LearnDeepSpeed are comparing it to the libraries listed below

• wdndev / mllm_interview_note
  主要记录大语言大模型（LLMs） 算法（应用）工程师多模态相关知识
  ☆266Updated last year
• xxcheng0708 / pytorch-model-train-template
  pytorch单精度、半精度、混合精度、单卡、多卡（DP / DDP）、FSDP、DeepSpeed模型训练代码，并对比不同方法的训练速度以及GPU内存的使用
  ☆129Updated last year
• Ablustrund / LoRAMoE
  LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment
  ☆395Updated last year
• Glanvery / LLM-Travel
  欢迎来到 "LLM-travel" 仓库！探索大语言模型（LLM）的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。
  ☆368Updated last year
• Victorwz / Open-Qwen2VL
  [COLM 2025] Open-Qwen2VL: Compute-Efficient Pre-Training of Fully-Open Multimodal LLMs on Academic Resources
  ☆305Updated 5 months ago
• swordlidev / Efficient-Multimodal-LLMs-Survey
  Efficient Multimodal Large Language Models: A Survey
  ☆387Updated 9 months ago
• GAIR-NLP / MAYE
  Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme
  ☆147Updated 9 months ago
• OvJat / DeepSpeedTutorial
  DeepSpeed Tutorial
  ☆105Updated last year
• step-law / steplaw
  ☆209Updated 3 months ago
• yuanzhoulvpi2017 / vscode_debug_transformers
  ☆413Updated 11 months ago
• qingkelab / qingketalk
  青稞Talk
  ☆190Updated 2 weeks ago
• chunhuizhang / llm_rl
  llm & rl
  ☆271Updated 3 months ago
• datawhalechina / sora-tutorial
  ☆103Updated last year
• AI-Study-Han / Zero-Qwen-VL
  训练一个对中文支持更好的LLaVA模型，并开源训练代码和数据。
  ☆79Updated last year
• liujunwen23 / MIRE
  WWW2025 Multimodal Intent Recognition for Dialogue Systems Challenge
  ☆130Updated last year
• chunhuizhang / pytorch_distribute_tutorials
  pytorch distribute tutorials
  ☆170Updated 7 months ago
• yongliang-wu / DFT
  [ICLR 2026] On the Generalization of SFT: A Reinforcement Learning Perspective with Reward Rectification.
  ☆532Updated last month
• OpenRLHF / OpenRLHF-M
  An Easy-to-use, Scalable and High-performance RLHF Framework designed for Multimodal Models.
  ☆154Updated last month
• liangyuwang / zo2
  ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory [COLM2025]
  ☆199Updated 6 months ago
• yfzhang114 / Awesome-Multimodal-Large-Language-Models
  Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Models
  ☆910Updated this week
• Outsider565 / LoRA-GA
  ☆218Updated 2 months ago
• Coobiw / MPP-LLaVA
  Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conv…
  ☆587Updated 10 months ago
• hengjiUSTC / learn-llm
  ☆115Updated last year
• Visual-Agent / DeepEyes
  ☆1,112Updated 2 months ago
• HarderThenHarder / RLLoggingBoard
  A visuailzation tool to make deep understaning and easier debugging for RLHF training.
  ☆283Updated 11 months ago
• chunhuizhang / personal_chatgpt
  personal chatgpt
  ☆406Updated 3 weeks ago
• RLHF-V / RLAIF-V
  [CVPR'25 highlight] RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthiness
  ☆442Updated 8 months ago
• yang19527 / AwesomeInterview
  包含程序员面试大厂面试题和面试经验
  ☆206Updated 8 months ago
• zhanshijinwat / Steel-LLM
  Train a 1B LLM with 1T tokens from scratch by personal
  ☆787Updated 9 months ago
• bojone / papers.cool
  Cool Papers - Immersive Paper Discovery
  ☆701Updated 5 months ago