Alternatives and similar repositories for OpenRLHF

Users that are interested in OpenRLHF are comparing it to the libraries listed below

• verl-project / verl
  verl: Volcano Engine Reinforcement Learning for LLMs
  ☆19,132Updated this week
• hiyouga / EasyR1
  EasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRL
  ☆4,572Updated 2 weeks ago
• hkust-nlp / simpleRL-reason
  Simple RL training for reasoning
  ☆3,830Updated last month
• Unakar / Logic-RL
  Reproduce R1 Zero on Logic Puzzle
  ☆2,432Updated 10 months ago
• PeterGriffinJin / Search-R1
  Search-R1: An Efficient, Scalable RL Training Framework for Reasoning & Search Engine Calling interleaved LLM based on veRL
  ☆3,975Updated 2 months ago
• modelscope / ms-swift
  Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3, Qwen3-MoE, DeepSeek-R1, GLM4.5, InternLM3, Llama4, ...) and 300+ MLLMs (…
  ☆12,594Updated this week
• open-compass / opencompass
  OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, …
  ☆6,663Updated this week
• eric-mitchell / direct-preference-optimization
  Reference implementation for DPO (Direct Preference Optimization)
  ☆2,850Updated last year
• openreasoner / openr
  OpenR: An Open Source Framework for Advanced Reasoning with Large Language Models
  ☆1,833Updated last year
• Open-Reasoner-Zero / Open-Reasoner-Zero
  Official Repo for Open-Reasoner-Zero
  ☆2,087Updated 8 months ago
• rllm-org / rllm
  Democratizing Reinforcement Learning for LLMs
  ☆5,081Updated this week
• huggingface / trl
  Train transformer language models with reinforcement learning.
  ☆17,297Updated last week
• inclusionAI / AReaL
  Lightning-Fast RL for LLM Reasoning and Agents. Made Simple & Flexible.
  ☆3,509Updated this week
• GAIR-NLP / O1-Journey
  O1 Replication Journey
  ☆2,000Updated last year
• lsdefine / simple_GRPO
  A very simple GRPO implement for reproducing r1-like LLM thinking.
  ☆1,575Updated 2 months ago
• zhaochenyang20 / Awesome-ML-SYS-Tutorial
  My learning notes for ML SYS.
  ☆5,306Updated last week
• alibaba / ROLL
  An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models
  ☆2,781Updated this week
• mll-lab-nu / RAGEN
  RAGEN leverages reinforcement learning to train LLM reasoning agents in interactive, stochastic environments.
  ☆2,511Updated 2 weeks ago
• open-compass / VLMEvalKit
  Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
  ☆3,799Updated last week
• TsinghuaC3I / Awesome-RL-for-LRMs
  A Survey of Reinforcement Learning for Large Reasoning Models
  ☆2,328Updated 3 months ago
• InternLM / lmdeploy
  LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
  ☆7,606Updated this week
• THUDM / slime
  slime is an LLM post-training framework for RL Scaling.
  ☆3,842Updated this week
• BytedTsinghua-SIA / DAPO
  An Open-source RL System from ByteDance Seed and Tsinghua AIR
  ☆1,727Updated 9 months ago
• allenai / open-instruct
  AllenAI's post-training codebase
  ☆3,573Updated this week
• PRIME-RL / PRIME
  Scalable RL solution for advanced reasoning of language models
  ☆1,803Updated 10 months ago
• xlite-dev / Awesome-LLM-Inference
  📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
  ☆4,969Updated 3 weeks ago
• atfortes / Awesome-LLM-Reasoning
  From Chain-of-Thought prompting to OpenAI o1 and DeepSeek-R1 🍓
  ☆3,534Updated 9 months ago
• hijkzzz / Awesome-LLM-Strawberry
  A collection of LLM papers, blogs, and projects, with a focus on OpenAI o1 🍓 and reasoning techniques.
  ☆6,893Updated last month
• StarsfieldAI / R1-V
  Witness the aha moment of VLM with less than $3.
  ☆4,029Updated 8 months ago
• Xnhyacinth / Awesome-LLM-Long-Context-Modeling
  📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥
  ☆1,909Updated 3 weeks ago