Alternatives and similar repositories for rlhf-ppo:

Users that are interested in rlhf-ppo are comparing it to the libraries listed below

• 0xallam / Direct-Preference-Optimization
  Direct Preference Optimization from scratch in PyTorch
  ☆91Updated last month
• BrendanGraham14 / mcts-llm
  ☆122Updated 10 months ago
• mengdi-li / awesome-RLAIF
  A continually updated list of literature on Reinforcement Learning from AI Feedback (RLAIF)
  ☆163Updated 3 months ago
• eddycmu / demystify-long-cot
  ☆287Updated last month
• yihedeng9 / rlhf-summary-notes
  A brief and partial summary of RLHF algorithms.
  ☆128Updated 2 months ago
• vwxyzjn / summarize_from_feedback_details
  ☆138Updated 5 months ago
• ZubinGou / math-evaluation-harness
  A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨
  ☆209Updated last year
• open-thought / tiny-grpo
  Minimal hackable GRPO implementation
  ☆217Updated 3 months ago
• RUC-GSAI / YuLan-Mini
  A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.
  ☆176Updated 3 weeks ago
• GAIR-NLP / ToRL
  ☆153Updated last month
• Mohammadjafari80 / GSM8K-RLVR
  A simplified implementation for experimenting with Reinforcement Learning (RL) on GSM8K, inspired by RLVR and Deepseek R1. This repositor…
  ☆84Updated 3 months ago
• GAIR-NLP / LIMR
  ☆192Updated 2 months ago
• tongyx361 / Awesome-LLM4Math
  Curation of resources for LLM mathematical reasoning, most of which are screened by @tongyx361 to ensure high quality and accompanied wit…
  ☆123Updated 9 months ago
• jwhj / OREO
  ☆109Updated 3 months ago
• joey00072 / nanoGRPO
  nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)
  ☆103Updated 3 weeks ago
• ezelikman / STaR
  Code for STaR: Bootstrapping Reasoning With Reasoning (NeurIPS 2022)
  ☆205Updated 2 years ago
• YifeiZhou02 / ArCHer
  Research Code for "ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL"
  ☆167Updated 3 weeks ago
• knoveleng / open-rs
  Official repo for paper: "Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn't"
  ☆220Updated last month
• Wangmerlyn / MCTS-GSM8k-Demo
  This is a repo for showcasing using MCTS with LLMs to solve gsm8k problems
  ☆75Updated last month
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆87Updated last month
• neubig / minllama-assignment
  ☆85Updated 7 months ago
• OFA-Sys / gsm8k-ScRel
  Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models
  ☆261Updated 7 months ago
• Vance0124 / Token-level-Direct-Preference-Optimization
  Reference implementation for Token-level Direct Preference Optimization(TDPO)
  ☆138Updated 2 months ago
• WeiminXiong / MPO
  MPO: Boosting LLM Agents with Meta Plan Optimization
  ☆50Updated 2 months ago
• TIGER-AI-Lab / CritiqueFineTuning
  Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate"
  ☆141Updated 2 weeks ago
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆459Updated last year
• SkyworkAI / skywork-o1-prm-inference
  ☆63Updated 5 months ago
• zjunlp / WKM
  [NeurIPS 2024] Agent Planning with World Knowledge Model
  ☆131Updated 4 months ago
• Dereck0602 / Awesome_Test_Time_LLMs
  ☆95Updated last month
• YuxiXie / MCTS-DPO
  This is the repository that contains the source code for the Self-Evaluation Guided MCTS for online DPO.
  ☆306Updated 9 months ago