jackfsuia / nanoRLHFLinks
RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.
☆73Updated 7 months ago
Alternatives and similar repositories for nanoRLHF
Users that are interested in nanoRLHF are comparing it to the libraries listed below
Sorting:
- This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems☆91Updated 6 months ago
- ☆65Updated 10 months ago
- On Memorization of Large Language Models in Logical Reasoning☆72Updated 6 months ago
- ☆78Updated last month
- Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models☆267Updated last year
- ☆96Updated 9 months ago
- [ACL-25] We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.☆68Updated 11 months ago
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆217Updated 2 months ago
- OpenRFT: Adapting Reasoning Foundation Model for Domain-specific Tasks with Reinforcement Fine-Tuning☆149Updated 9 months ago
- Pretrain、decay、SFT a CodeLLM from scratch 🧙♂️☆39Updated last year
- ☆34Updated last year
- ☆129Updated last year
- ☆105Updated 2 months ago
- ☆151Updated 10 months ago
- ☆104Updated 10 months ago
- [EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs☆256Updated 9 months ago
- ☆211Updated 7 months ago
- This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…☆58Updated last year
- ☆33Updated 7 months ago
- Fantastic Data Engineering for Large Language Models☆89Updated 9 months ago
- ☆33Updated 4 months ago
- Counting-Stars (★)☆83Updated 4 months ago
- Inference Code for Paper "Harder Tasks Need More Experts: Dynamic Routing in MoE Models"☆63Updated last year
- Curation of resources for LLM mathematical reasoning, most of which are screened by @tongyx361 to ensure high quality and accompanied wit…☆142Updated last year
- ☆83Updated last year
- A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.☆246Updated 5 months ago
- A research repo for experiments about Reinforcement Finetuning☆52Updated 6 months ago
- CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models☆43Updated last year
- ☆115Updated last year
- xVerify: Efficient Answer Verifier for Reasoning Model Evaluations☆131Updated 5 months ago