jianzhnie / Open-R1
The open source implementation of DeepSeek-R1. 开源复现 DeepSeek-R1
☆229Updated this week
Alternatives and similar repositories for Open-R1:
Users that are interested in Open-R1 are comparing it to the libraries listed below
- ☆304Updated last year
- A full pipeline to finetune ChatGLM LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Huma…☆134Updated last year
- Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat☆112Updated last year
- Implementation of Chinese ChatGPT☆287Updated last year
- 使用qlora对中文大语言模型进行微调，包含ChatGLM、Chinese-LLaMA-Alpaca、BELLE☆85Updated last year
- baichuan LLM surpervised finetune by lora☆62Updated last year
- 怎么训练一个LLM分词器☆140Updated last year
- 演示 vllm 对中文大语言模型的神奇效果☆31Updated last year
- deep learning☆150Updated 8 months ago
- Baichuan2代码的逐行解析版本，适合小白☆212Updated last year
- A full pipeline to finetune Vicuna LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human…☆211Updated 9 months ago
- 中文大模型微调(LLM-SFT), 数学指令数据集MWP-Instruct, 支持模型(ChatGLM-6B, LLaMA, Bloom-7B, baichuan-7B), 支持(LoRA, QLoRA, DeepSpeed, UI, TensorboardX), 支持(微…☆185Updated 9 months ago
- train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism☆215Updated last year
- The official codes for "Aurora: Activating chinese chat capability for Mixtral-8x7B sparse Mixture-of-Experts through Instruction-Tuning"☆260Updated 9 months ago
- 大语言模型指令调优工具（支持 FlashAttention）☆169Updated last year
- MEASURING MASSIVE MULTITASK CHINESE UNDERSTANDING☆88Updated 10 months ago
- 百川Dynamic NTK-ALiBi的代码实现：无需微调即可推理更长文本☆47Updated last year
- 用于大模型 RLHF 进行人工数据标注排序的工具。A tool for manual response data annotation sorting in RLHF stage.☆247Updated last year
- Imitate OpenAI with Local Models☆86Updated 5 months ago
- Chinese large language model base generated through incremental pre-training on Chinese datasets☆235Updated last year
- The Roadmap for LLMs☆85Updated last year
- ☆43Updated last year
- chatglm_rlhf_finetuning☆28Updated last year
- llama fine-tuning with lora☆140Updated 9 months ago
- A visuailzation tool to make deep understaning and easier debugging for RLHF training.☆148Updated this week
- 对ChatGLM直接使用RLHF提升或降低目标输出概率|Modify ChatGLM output with only RLHF☆192Updated last year
- alpaca中文指令微调数据集☆392Updated last year
- ☆278Updated 9 months ago
- a Fine-tuned LLaMA that is Good at Arithmetic Tasks☆177Updated last year
- moss chat finetuning☆50Updated 9 months ago