Alternatives and similar repositories for rlhf-ppo:

Users that are interested in rlhf-ppo are comparing it to the libraries listed below

• 0xallam / Direct-Preference-Optimization
  Direct Preference Optimization from scratch in PyTorch
  ☆90Updated last week
• neubig / minllama-assignment
  ☆84Updated 6 months ago
• RUC-GSAI / YuLan-Mini
  A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.
  ☆170Updated this week
• joey00072 / nanoGRPO
  nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)
  ☆97Updated this week
• vwxyzjn / summarize_from_feedback_details
  ☆137Updated 4 months ago
• jwhj / OREO
  ☆105Updated 2 months ago
• knoveleng / open-rs
  Official repo for paper: "Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn't"
  ☆195Updated 3 weeks ago
• CMU-AIRe / MRT
  Research Code for preprint "Optimizing Test-Time Compute via Meta Reinforcement Finetuning".
  ☆90Updated last month
• BrendanGraham14 / mcts-llm
  ☆118Updated 9 months ago
• cmu-l3 / l1
  L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning
  ☆180Updated 3 weeks ago
• Open-Source-O1 / o1_Reasoning_Patterns_Study
  ☆101Updated 4 months ago
• vwxyzjn / lm-human-preference-details
  RLHF implementation details of OAI's 2019 codebase
  ☆186Updated last year
• Mohammadjafari80 / GSM8K-RLVR
  A simplified implementation for experimenting with Reinforcement Learning (RL) on GSM8K, inspired by RLVR and Deepseek R1. This repositor…
  ☆74Updated 2 months ago
• Ber666 / RAP
  Reasoning with Language Model is Planning with World Model
  ☆163Updated last year
• eddycmu / demystify-long-cot
  ☆278Updated last month
• FairyFali / SLMs-Survey
  Survey of Small Language Models from Penn State, ...
  ☆171Updated 3 months ago
• kyegomez / Lets-Verify-Step-by-Step
  "Improving Mathematical Reasoning with Process Supervision" by OPENAI
  ☆108Updated last week
• ZubinGou / math-evaluation-harness
  A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨
  ☆199Updated 11 months ago
• GAIR-NLP / ToRL
  ☆99Updated 2 weeks ago
• Dereck0602 / Awesome_Test_Time_LLMs
  ☆91Updated last month
• yihedeng9 / rlhf-summary-notes
  A brief and partial summary of RLHF algorithms.
  ☆127Updated last month
• tianyi-lab / Reflection_Tuning
  [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  ☆354Updated 7 months ago
• ezelikman / STaR
  Code for STaR: Bootstrapping Reasoning With Reasoning (NeurIPS 2022)
  ☆203Updated 2 years ago
• open-thought / tiny-grpo
  Minimal hackable GRPO implementation
  ☆206Updated 2 months ago
• YuxiXie / MCTS-DPO
  This is the repository that contains the source code for the Self-Evaluation Guided MCTS for online DPO.
  ☆301Updated 8 months ago
• facebookresearch / sweet_rl
  Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks
  ☆175Updated this week
• allenai / reward-bench
  RewardBench: the first evaluation tool for reward models.
  ☆553Updated last month
• tongyx361 / Awesome-LLM4Math
  Curation of resources for LLM mathematical reasoning, most of which are screened by @tongyx361 to ensure high quality and accompanied wit…
  ☆122Updated 9 months ago
• LCLM-Horizon / A-Comprehensive-Survey-For-Long-Context-Language-Modeling
  A Comprehensive Survey on Long Context Language Modeling
  ☆129Updated 3 weeks ago
• for-ai / parameter-efficient-moe
  ☆255Updated last year