jackfsuia / nanoRLHF
RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.
☆58Updated 2 months ago
Alternatives and similar repositories for nanoRLHF
Users that are interested in nanoRLHF are comparing it to the libraries listed below
Sorting:
- ☆63Updated 5 months ago
- This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems☆76Updated last month
- OpenRFT: Adapting Reasoning Foundation Model for Domain-specific Tasks with Reinforcement Fine-Tuning☆135Updated 4 months ago
- On Memorization of Large Language Models in Logical Reasoning☆64Updated last month
- Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (…☆77Updated this week
- ☆153Updated last month
- This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…☆56Updated last year
- ☆98Updated 7 months ago
- Research Code for preprint "Optimizing Test-Time Compute via Meta Reinforcement Finetuning".☆93Updated 2 months ago
- Reference implementation for Token-level Direct Preference Optimization(TDPO)☆138Updated 3 months ago
- [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection☆44Updated 6 months ago
- ☆41Updated 3 months ago
- ☆30Updated 8 months ago
- xVerify: Efficient Answer Verifier for Reasoning Model Evaluations☆94Updated 3 weeks ago
- ☆66Updated 5 months ago
- AIMO2 2nd place solution☆53Updated 3 weeks ago
- this is an implementation for the paper Improve Mathematical Reasoning in Language Models by Automated Process Supervision from google de…☆30Updated last month
- We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.☆62Updated 6 months ago
- ☆32Updated 5 months ago
- ☆132Updated 2 weeks ago
- Exploring the Limit of Outcome Reward for Learning Mathematical Reasoning☆174Updated last month
- The related works and background techniques about Openai o1☆221Updated 4 months ago
- Official codebase for "GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning".☆72Updated 2 weeks ago
- A research repo for experiments about Reinforcement Finetuning☆46Updated last month
- Curation of resources for LLM mathematical reasoning, most of which are screened by @tongyx361 to ensure high quality and accompanied wit…☆125Updated 10 months ago
- ☆122Updated 10 months ago
- ☆133Updated 3 months ago
- ☆94Updated 4 months ago
- Pretrain、decay、SFT a CodeLLM from scratch 🧙♂️☆35Updated 11 months ago
- [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models☆76Updated last year