Alternatives and similar repositories for DeepSeek-R1-TrainingSuite

Users that are interested in DeepSeek-R1-TrainingSuite are comparing it to the libraries listed below

• 360CVGroup / 360VL
  Our 2nd-gen LMM
  ☆34Updated last year
• gabrielolympie / moe-pruner
  A repository aimed at pruning DeepSeek V3, R1 and R1-zero to a usable size
  ☆65Updated 4 months ago
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆41Updated last year
• Efficient-ML / Qwen3-Quantization
  ☆36Updated 2 months ago
• liangyuwang / zo2
  ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory
  ☆167Updated last month
• woct0rdho / transformers-qwen3-moe-fused
  Fused Qwen3 MoE layer for faster training, compatible with HF Transformers, LoRA, 4-bit quant, Unsloth
  ☆147Updated 2 weeks ago
• bigai-nlco / TokenSwift
  [ICML 2025] |TokenSwift: Lossless Acceleration of Ultra Long Sequence Generation
  ☆113Updated 2 months ago
• Bui1dMySea / MemLong
  ☆94Updated 8 months ago
• JT-Ushio / MHA2MLA
  Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
  ☆183Updated last month
• 18907305772 / FuseAI
  FuseAI Project
  ☆87Updated 6 months ago
• pangu-tech / pangu-ultra
  ☆67Updated 2 months ago
• xverse-ai / XVERSE-MoE-A36B
  XVERSE-MoE-A36B: A multilingual large language model developed by XVERSE Technology Inc.
  ☆39Updated 11 months ago
• OpenBMB / CPM.cu
  CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge tec…
  ☆171Updated 2 weeks ago
• yyht / openrlhf_async_pipline
  ☆72Updated last week
• crazycth / WizardLearner
  Pretrain、decay、SFT a CodeLLM from scratch 🧙‍♂️
  ☆37Updated last year
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆94Updated 5 months ago
• StarRing2022 / R1-Nature
  最简易的R1结果在小模型上的复现，阐述类O1与DeepSeek R1最重要的本质。Think is all your need。利用实验佐证，对于强推理能力，think思考过程性内容是AGI/ASI的核心。
  ☆44Updated 6 months ago
• shiyemin / light-hf-proxy
  A light proxy solution for HuggingFace hub.
  ☆46Updated last year
• zai-org / GLM-Edge
  GLM Series Edge Models
  ☆147Updated 2 months ago
• TencentARC / mllm-npu
  mllm-npu: training multimodal large language models on Ascend NPUs
  ☆91Updated 11 months ago
• zhaochenyang20 / Prompt2Model-Self-Guide
  SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper
  ☆33Updated last year
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆136Updated last year
• thunlp / Delta-CoMe
  Delta-CoMe can achieve near loss-less 1-bit compressin which has been accepted by NeurIPS 2024
  ☆56Updated 9 months ago
• GuoYiFantastic / IMelodist
  Music large model based on InternLM2-chat.
  ☆22Updated 7 months ago
• Tencent / digitalhuman
  ☆96Updated last week
• WalkerMitty / Fast-Llama2
  Fast instruction tuning with Llama2
  ☆11Updated last year
• jackfsuia / nanoRLHF
  RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.
  ☆68Updated 5 months ago
• ArtificialZeng / llama3_explained
  the newest version of llama3，source code explained line by line using Chinese
  ☆22Updated last year
• nengelmann / Fuyu-8B---Exploration
  Exploration of the multi modal fuyu-8b model of Adept. 🤓 🔍
  ☆28Updated last year
• Gen-Verse / ScoreFlow
  Official implementation for "ScoreFlow: Mastering LLM Agent Workflows via Score-based Preference Optimization"
  ☆80Updated 2 months ago