FareedKhan-dev / train-deepseek-r1Links
Building DeepSeek R1 from Scratch
☆630Updated 3 months ago
Alternatives and similar repositories for train-deepseek-r1
Users that are interested in train-deepseek-r1 are comparing it to the libraries listed below
Sorting:
- 一个手把手教你从零开始编写GPT并训练大语言模型的教程☆82Updated 5 months ago
- ☆717Updated 3 weeks ago
- 这是一个从头训练大语言模型的项目,包括预训练、微调和直接偏好优化,模型拥有1B参数,支持中英文。☆437Updated 4 months ago
- An open-source solution for full parameter fine-tuning of DeepSeek-V3/R1 671B, including complete code and scripts from training to infer…☆703Updated 3 months ago
- Distributed RL System for LLM Reasoning☆1,837Updated this week
- 从零实现一个小参数量中文大语言模型。☆709Updated 10 months ago
- A very simple GRPO implement for reproducing r1-like LLM thinking.☆1,130Updated 2 months ago
- Awesome LLM pre-training resources, including data, frameworks, and methods.☆184Updated last month
- LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.☆782Updated this week
- Reproduce R1 Zero on Logic Puzzle☆2,361Updated 3 months ago
- 从0开始,将chatgpt的技术路线跑一遍。☆242Updated 9 months ago
- Collect every awesome work about r1!☆388Updated last month
- 从0到1构建一个MiniLLM (pretrain+sft+dpo实践中)☆444Updated 3 months ago
- 一些 LLM 方面的从零复现笔记☆203Updated last month
- Train a 1B LLM with 1T tokens from scratch by personal☆685Updated 2 months ago
- minimal-cost for training 0.5B R1-Zero☆743Updated last month
- DeepSeek 系列工作解读、扩展和复现。☆658Updated 2 months ago
- Unify Efficient Fine-tuning of RAG Retrieval, including Embedding, ColBERT, ReRanker.☆941Updated 2 weeks ago
- Scalable RL solution for advanced reasoning of language models☆1,622Updated 3 months ago
- Train a Language Model with GRPO to create a schedule from a list of events and priorities☆206Updated last month
- MoBA: Mixture of Block Attention for Long-Context LLMs☆1,803Updated 2 months ago
- 从零实现一个 llama3 中文版☆913Updated last year
- ReCall: Learning to Reason with Tool Call for LLMs via Reinforcement Learning☆969Updated last month
- 一个很小很小的RAG系统☆253Updated last month
- R1-searcher: Incentivizing the Search Capability in LLMs via Reinforcement Learning☆566Updated last month
- DL & ML & RS☆410Updated 7 months ago
- ☆205Updated last month
- Awesome Reasoning LLM Tutorial/Survey/Guide☆1,781Updated last week
- 该系列的目的是让读者可以在基础的pytorch上,不依赖任何其他现成的外部库,从零开始理解并实现一个大语言模型的所有组成部分,以及训练微调代码,因此读者仅需python,pytorch和最基础深度学习背景知识即可。☆343Updated 3 months ago
- Latest Advances on System-2 Reasoning☆1,128Updated 2 weeks ago