Alternatives and similar repositories for LLM-RLHF-Tuning-with-PPO-and-DPO

Users that are interested in LLM-RLHF-Tuning-with-PPO-and-DPO are comparing it to the libraries listed below

• Oxen-AI / Self-Rewarding-Language-Models
  This is work done by the Oxen.ai Community, trying to reproduce the Self-Rewarding Language Model paper from MetaAI.
  ☆132Updated last year
• Linear95 / SPAG
  Self-playing Adversarial Language Game Enhances LLM Reasoning, NeurIPS 2024
  ☆142Updated 10 months ago
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆102Updated 9 months ago
• Mohammadjafari80 / GSM8K-RLVR
  A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.
  ☆153Updated 11 months ago
• jwhj / OREO
  ☆116Updated 11 months ago
• THU-KEG / Agentic-Reward-Modeling
  [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems
  ☆119Updated 6 months ago
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆312Updated 3 months ago
• OpenBMB / Eurus
  ☆320Updated last year
• sunblaze-ucb / Intuitor
  Code for the paper: "Learning to Reason without External Rewards"
  ☆385Updated 5 months ago
• SqueezeAILab / LLM2LLM
  [ACL 2024] LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement
  ☆192Updated last year
• xfactlab / orpo
  Official repository for ORPO
  ☆468Updated last year
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆234Updated 5 months ago
• facebookresearch / sweet_rl
  Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks
  ☆254Updated 8 months ago
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆152Updated 11 months ago
• THUDM / T1
  RL Scaling and Test-Time Scaling (ICML'25)
  ☆112Updated 11 months ago
• allenai / lumos
  Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"
  ☆473Updated last year
• open-thought / tiny-grpo
  Minimal hackable GRPO implementation
  ☆309Updated 11 months ago
• BrendanGraham14 / mcts-llm
  ☆130Updated last year
• sher222 / LeReT
  Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval
  ☆51Updated last year
• SiliangZeng / Multi-Turn-RL-Agent
  ☆102Updated 6 months ago
• sail-sg / oat
  🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.
  ☆609Updated this week
• architsharma97 / dpo-rlaif
  ☆100Updated last year
• ezelikman / STaR
  Code for STaR: Bootstrapping Reasoning With Reasoning (NeurIPS 2022)
  ☆217Updated 2 years ago
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆174Updated 11 months ago
• vwxyzjn / summarize_from_feedback_details
  ☆160Updated last year
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆259Updated 8 months ago
• microsoft / simulated-trial-and-error
  ☆122Updated last year
• tianyi-lab / Reflection_Tuning
  [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  ☆366Updated last year
• ByteDance-Seed / Agent-R
  Resources for our paper: "Agent-R: Training Language Model Agents to Reflect via Iterative Self-Training"
  ☆166Updated 2 months ago
• waterhorse1 / LLM_Tree_Search
  (ICML 2024) Alphazero-like Tree-Search can guide large language model decoding and training
  ☆284Updated last year