The open source implementation of DeepSeek-R1. 开源复现 DeepSeek-R1
☆276Mar 10, 2025Updated last year
Alternatives and similar repositories for Open-R1
Users that are interested in Open-R1 are comparing it to the libraries listed below
Sorting:
- RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.☆79Feb 19, 2025Updated last year
- Optimizing Deeper Transformers on Small Datasets https://arxiv.org/abs/2012.15355☆16Nov 2, 2022Updated 3 years ago
- Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.☆620Jan 24, 2025Updated last year
- 一个基于HuggingFace开发的大语言模型训练、测试工具。支持各模型的webui、终端预测，低参数量及全参数模型训练(预训练、SFT、RM、PPO、DPO)和融合、量化。☆223Dec 8, 2023Updated 2 years ago
- 用于大模型 RLHF 进行人工数据标注排序的工具。A tool for manual response data annotation sorting in RLHF stage.☆256Aug 1, 2023Updated 2 years ago
- Open source implementation of InstructGPT (not finished)☆31Apr 13, 2023Updated 2 years ago
- LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA☆239Aug 17, 2025Updated 7 months ago
- DeepSeek 系列工作解读、扩展和复现。☆710Mar 9, 2026Updated last week
- 🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production☆37Mar 10, 2022Updated 4 years ago
- Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat☆117Jun 5, 2023Updated 2 years ago
- LLM Tuning with PEFT (SFT+RM+PPO+DPO with LoRA)☆453Oct 11, 2023Updated 2 years ago
- 大语言模型训练和服务调研☆37Aug 4, 2023Updated 2 years ago
- Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调☆3,730Oct 12, 2023Updated 2 years ago
- BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）☆8,286Oct 16, 2024Updated last year
- Production First and Production Ready End-to-End Keyword Spotting Toolkit☆12May 30, 2022Updated 3 years ago
- ☆34Mar 25, 2023Updated 2 years ago
- LONGAGENT: Scaling Language Models to 128k Context through Multi-Agent Collaboration☆11Mar 11, 2024Updated 2 years ago
- 🛰️ 基于真实医疗对话数据在ChatGLM上进行LoRA、P-Tuning V2、Freeze、RLHF等微调，我们的眼光不止于医疗问答☆337Sep 2, 2023Updated 2 years ago
- ☆16Oct 24, 2023Updated 2 years ago
- Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback☆1,591Nov 24, 2025Updated 3 months ago
- Implementation of ChatGPT RLHF (Reinforcement Learning with Human Feedback) on any generation model in huggingface's transformer (blommz-…☆564May 9, 2024Updated last year
- ☆59Jul 21, 2025Updated 8 months ago
- ☆13Sep 20, 2023Updated 2 years ago
- 这是一个open-r1的复现项目，对0.5B、1.5B、3B、7B的qwen模型进行GRPO训练，观察到一些有趣的现象。☆56Apr 13, 2025Updated 11 months ago
- Secrets of RLHF in Large Language Models Part I: PPO☆1,420Mar 3, 2024Updated 2 years ago
- 基于BERT-CRF的命名实体识别模型☆13Mar 14, 2022Updated 4 years ago
- Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model —— 一个中文低资源的llama+lora方案，结构参考alpaca☆4,134Apr 18, 2025Updated 11 months ago
- Example models using DeepSpeed☆6,807Mar 4, 2026Updated 2 weeks ago
- Open-source pre-training implementation of Google's LaMDA in PyTorch. Adding RLHF similar to ChatGPT.☆470Feb 24, 2024Updated 2 years ago
- ChatGLM-6B fine-tuning.☆136Apr 25, 2023Updated 2 years ago
- Implementation of Reinforcement Learning from Human Feedback (RLHF)☆174Apr 7, 2023Updated 2 years ago
- 聚宝盆(Cornucopia): 中文金融系列开源可商用大模型，并提供一套高效轻量化的垂直领域LLM训练框架(Pretraining、SFT、RLHF、Quantize等)☆658Jun 30, 2023Updated 2 years ago
- 对ChatGLM直接使用RLHF提升或降低目标输出概率|Modify ChatGLM output with only RLHF☆198May 23, 2023Updated 2 years ago
- Rethinking Data Perturbation and Model Stabilization for Semi-supervised Medical Image Segmentation☆14Aug 15, 2023Updated 2 years ago
- A full pipeline to finetune ChatGLM LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Huma…☆140Apr 28, 2023Updated 2 years ago
- LOMO: LOw-Memory Optimization☆989Jul 2, 2024Updated last year
- A large-scale 7B pretraining language model developed by BaiChuan-Inc.☆5,677Jul 18, 2024Updated last year
- GTS Engine: A powerful NLU Training System。GTS引擎（GTS-Engine）是一款开箱即用且性能强大的自然语言理解引擎，聚焦于小样本任务，能够仅用小样本就能自动化生产NLP模型。☆93Feb 28, 2023Updated 3 years ago
- Panda项目是于2023年5月启动的开源海外中文大语言模型项目，致力于大模型时代探索整个技术栈，旨在推动中文自然语言处理领域的创新和合作。☆1,036Oct 19, 2023Updated 2 years ago