FareedKhan-dev / train-deepseek-r1
Building DeepSeek R1 from Scratch
☆572Updated last month
Alternatives and similar repositories for train-deepseek-r1:
Users that are interested in train-deepseek-r1 are comparing it to the libraries listed below
- ☆673Updated last week
- An open-source solution for full parameter fine-tuning of DeepSeek-V3/R1 671B, including complete code and scripts from training to infer…☆659Updated last month
- DeepSeek 系列工作解读、扩展和复现。☆627Updated 3 weeks ago
- Distributed RL System for LLM Reasoning☆1,164Updated this week
- 一个手把手教你从零开始编写GPT并训练大语言模型的教程☆71Updated 3 months ago
- LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.☆732Updated this week
- ReCall: Learning to Reason with Tool Call for LLMs via Reinforcement Learning☆714Updated this week
- DL & ML & RS☆332Updated 5 months ago
- minimal-cost for training 0.5B R1-Zero☆706Updated this week
- Reproduce R1 Zero on Logic Puzzle☆2,319Updated last month
- 这是一个从头训练大语言模型的项目,包括预训练、微调和直接偏好优化,模型拥有1B参数,支持中英文。☆369Updated 2 months ago
- A very simple GRPO implement for reproducing r1-like LLM thinking.☆986Updated 3 weeks ago
- Awesome Reasoning LLM Tutorial/Survey/Guide☆1,436Updated 2 weeks ago
- Scalable RL solution for advanced reasoning of language models☆1,504Updated last month
- Official Repo for Open-Reasoner-Zero☆1,887Updated 2 weeks ago
- 从零实现一个小参数量中文大语言模型。☆611Updated 8 months ago
- My learning notes/codes for ML SYS.☆1,907Updated this week
- 从零实现一个 llama3 中文版☆849Updated 10 months ago
- Train a 1B LLM with 1T tokens from scratch by personal☆613Updated last month
- MoBA: Mixture of Block Attention for Long-Context LLMs☆1,755Updated 3 weeks ago
- A straightforward method for training your LLM, from downloading data to generating text.☆297Updated 2 weeks ago
- R1-searcher: Incentivizing the Search Capability in LLMs via Reinforcement Learning☆477Updated last week
- O1 Replication Journey☆1,985Updated 3 months ago
- EasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRL☆2,138Updated this week
- Understanding R1-Zero-Like Training: A Critical Perspective☆882Updated last week
- Latest Advances on System-2 Reasoning☆956Updated this week
- ☆936Updated 2 months ago
- Collect every awesome work about r1!☆349Updated this week
- 该系列的目的是让读者可以在基础的pytorch上,不依赖任何其他现成的外部库,从零开始理解并实现一个大语言模型的所有组成部分,以及训练微调代码,因此读者仅需python,pytorch和最基础深度学习背景知识即可。☆242Updated last month
- 一个很小很小的RAG系统☆207Updated 4 months ago