jackfsuia / nanoRLHFLinks
RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.
☆76Updated 10 months ago
Alternatives and similar repositories for nanoRLHF
Users that are interested in nanoRLHF are comparing it to the libraries listed below
Sorting:
- This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems☆94Updated last month
- ☆65Updated last year
- OpenRFT: Adapting Reasoning Foundation Model for Domain-specific Tasks with Reinforcement Fine-Tuning☆154Updated last year
- ☆130Updated last year
- ☆87Updated 4 months ago
- ☆105Updated last year
- ☆96Updated last year
- On Memorization of Large Language Models in Logical Reasoning☆72Updated 9 months ago
- ☆34Updated last year
- [ACL 2025] We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLM…☆68Updated last year
- ☆124Updated last year
- ☆32Updated 6 months ago
- A research repo for experiments about Reinforcement Finetuning☆53Updated 8 months ago
- Code for Paper (ReMax: A Simple, Efficient and Effective Reinforcement Learning Method for Aligning Large Language Models)☆199Updated 2 years ago
- Counting-Stars (★)☆83Updated last month
- [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs☆257Updated last year
- ☆109Updated 5 months ago
- ☆161Updated 11 months ago
- A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.☆249Updated 8 months ago
- Fantastic Data Engineering for Large Language Models☆93Updated last year
- ☆39Updated 9 months ago
- Pretrain、decay、SFT a CodeLLM from scratch 🧙♂️☆39Updated last year
- Reference implementation for Token-level Direct Preference Optimization(TDPO)☆150Updated 10 months ago
- The related works and background techniques about Openai o1☆221Updated 11 months ago
- ☆160Updated last year
- ☆214Updated 10 months ago
- Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models☆270Updated last year
- RL Scaling and Test-Time Scaling (ICML'25)☆112Updated 11 months ago
- Implementation of the ICML 2024 paper "Training Large Language Models for Reasoning through Reverse Curriculum Reinforcement Learning" pr…☆114Updated last year
- ☆83Updated last year