Alternatives and similar repositories for DeepSeek-R1-TrainingSuite

Users that are interested in DeepSeek-R1-TrainingSuite are comparing it to the libraries listed below

• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆40Updated 2 years ago
• jackfsuia / nanoRLHF
  RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.
  ☆79Updated 11 months ago
• gabrielolympie / moe-pruner
  A repository aimed at pruning DeepSeek V3, R1 and R1-zero to a usable size
  ☆83Updated 5 months ago
• zhaochenyang20 / Prompt2Model-Self-Guide
  SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper
  ☆32Updated last year
• 18907305772 / FuseAI
  FuseAI Project
  ☆87Updated last year
• ArtificialZeng / llama3_explained
  the newest version of llama3，source code explained line by line using Chinese
  ☆22Updated last year
• kyegomez / OpenR1
  An open source implementation of R1
  ☆29Updated this week
• GuoYiFantastic / IMelodist
  Music large model based on InternLM2-chat.
  ☆23Updated last year
• 360CVGroup / 360VL
  Our 2nd-gen LMM
  ☆34Updated last year
• RUC-GSAI / YuLan-Mini
  A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.
  ☆223Updated 6 months ago
• WalkerMitty / Fast-Llama2
  Fast instruction tuning with Llama2
  ☆11Updated last year
• wajihullahbaig / deepseekv3-minimal
  Creating the DeepSeek V3 model from scratch
  ☆24Updated 10 months ago
• bigai-nlco / TokenSwift
  [ICML 2025] |TokenSwift: Lossless Acceleration of Ultra Long Sequence Generation
  ☆121Updated 8 months ago
• StarRing2022 / R1-Nature
  最简易的R1结果在小模型上的复现，阐述类O1与DeepSeek R1最重要的本质。Think is all your need。利用实验佐证，对于强推理能力，think思考过程性内容是AGI/ASI的核心。
  ☆45Updated last year
• xverse-ai / XVERSE-MoE-A36B
  XVERSE-MoE-A36B: A multilingual large language model developed by XVERSE Technology Inc.
  ☆38Updated last year
• zai-org / GLM-Edge
  GLM Series Edge Models
  ☆158Updated 8 months ago
• crazycth / WizardLearner
  Pretrain、decay、SFT a CodeLLM from scratch 🧙‍♂️
  ☆40Updated last year
• inclusionAI / AWorld-RL
  Agentic Learning Powered by AWorld
  ☆88Updated this week
• shiyemin / light-hf-proxy
  A light proxy solution for HuggingFace hub.
  ☆49Updated 2 years ago
• pangu-tech / pangu-ultra
  ☆74Updated 8 months ago
• saxenarohit / MovieSum
  ☆19Updated last year
• Bui1dMySea / MemLong
  ☆96Updated last year
• yyht / openrlhf_async_pipline
  ☆87Updated 5 months ago
• gydpku / Data_Synthesis_RL
  ☆118Updated 8 months ago
• cooper12121 / llama3-8x8b-MoE
  Copy the MLP of llama3 8 times as 8 experts , created a router with random initialization,add load balancing loss to construct an 8x8b Mo…
  ☆27Updated last year
• woct0rdho / transformers-qwen3-moe-fused
  Fused Qwen3 MoE layer for faster training, compatible with Transformers, LoRA, bnb 4-bit quant, Unsloth. Also possible to train LoRA over…
  ☆231Updated last week
• tridao / flash-attention-wheels
  ☆61Updated 2 years ago
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆139Updated last year
• nengelmann / Fuyu-8B---Exploration
  Exploration of the multi modal fuyu-8b model of Adept. 🤓 🔍
  ☆27Updated 2 years ago
• ZhangYiqun018 / Avengers
  [AAAI 2026] The Avengers: A Simple Recipe for Uniting Smaller Language Models to Challenge Proprietary Giants
  ☆46Updated 2 months ago