Alternatives and similar repositories for DeepSeek-R1-TrainingSuite

Users that are interested in DeepSeek-R1-TrainingSuite are comparing it to the libraries listed below

• GuoYiFantastic / IMelodist
  Music large model based on InternLM2-chat.
  ☆22Updated 5 months ago
• yvonwin / qwen2.cpp
  qwen2 and llama3 cpp implementation
  ☆44Updated last year
• kabir2505 / tiny-mixtral
  ☆39Updated last month
• morsoli / llmbenchmark
  大模型API性能指标比较 - 深入分析TTFT、TPS等关键指标
  ☆17Updated 8 months ago
• crazycth / WizardLearner
  Pretrain、decay、SFT a CodeLLM from scratch 🧙‍♂️
  ☆35Updated last year
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆42Updated last year
• Chen-GX / C-3PO
  [ICML2025] The official implementation of "C-3PO: Compact Plug-and-Play Proxy Optimization to Achieve Human-like Retrieval-Augmented Gene…
  ☆22Updated last month
• liangyuwang / zo2
  ZO2 (Zeroth-Order Offloading): Full Parameter Fine-Tuning 175B LLMs with 18GB GPU Memory
  ☆95Updated last month
• IDEA-CCNL / Real-Gemini
  Real-time video understanding and interaction through text,audio,image and video with large multi-modal model. 利用多模态大模型的实时视频理解和交互框架，通过文本…
  ☆23Updated last year
• ArtificialZeng / llama3_explained
  the newest version of llama3，source code explained line by line using Chinese
  ☆22Updated last year
• matthewchung74 / qwen_2_5_3B_GRPO_medical_thinking
  ☆46Updated last month
• jiahe7ay / infini-mini-transformer
  This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…
  ☆56Updated last year
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆37Updated last year
• RUC-GSAI / YuLan-Mini
  A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.
  ☆186Updated this week
• tile-ai / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆18Updated last week
• cjymz886 / LLM-RAG-QA
  LLM+RAG for QA
  ☆22Updated last year
• hellangleZ / Qwen3_autothink_adapter
  Implemented a script that automatically adjusts Qwen3's inference and non-inference capabilities, based on an OpenAI-like API. The infere…
  ☆20Updated 3 weeks ago
• JT-Ushio / MHA2MLA
  Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs
  ☆167Updated this week
• WalkerMitty / Fast-Llama2
  Fast instruction tuning with Llama2
  ☆11Updated last year
• jackfsuia / nanoRLHF
  RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.
  ☆62Updated 3 months ago
• ironartisan / awesome-compression1
  模型压缩的小白入门教程
  ☆22Updated 11 months ago
• torphix / infini-attention
  Pytorch implementation of https://arxiv.org/html/2404.07143v1
  ☆20Updated last year
• AI-Study-Han / Zero-Qwen-VL
  训练一个对中文支持更好的LLaVA模型，并开源训练代码和数据。
  ☆60Updated 9 months ago
• shiyemin / light-hf-proxy
  A light proxy solution for HuggingFace hub.
  ☆47Updated last year
• ai-in-pm / rStar-Math
  rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinking
  ☆38Updated 4 months ago
• zhaochenyang20 / Prompt2Model-Self-Guide
  SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper
  ☆32Updated last year
• shreyansh26 / FlashAttention-PyTorch
  Implementation of FlashAttention in PyTorch
  ☆150Updated 4 months ago
• AI-Study-Han / Mini-Llama2-Chinese
  想要从零开始训练一个中文的mini大语言模型，可以进行基本的对话，模型大小根据手头的机器决定
  ☆59Updated 9 months ago
• tridao / flash-attention-wheels
  ☆49Updated last year
• yujunhuics / Reyes
  从零到一实现了一个多模态大模型，并命名为Reyes（睿视），R：睿，eyes：眼。Reyes的参数量为8B，视觉编码器使用的是InternViT-300M-448px-V2_5,语言模型侧使用的是Qwen2.5-7B-Instruct，Reyes也通过一个两层MLP投影层连…
  ☆13Updated 3 months ago