Alternatives and similar repositories for ReaLHF:

Users that are interested in ReaLHF are comparing it to the libraries listed below

• alibaba / ChatLearn
  A flexible and efficient training framework for large-scale alignment tasks
  ☆342Updated 2 months ago
• step-law / steplaw
  ☆179Updated last week
• sail-sg / oat-zero
  A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.
  ☆229Updated last week
• ByteDance-Seed / VeOmni
  VeOmni: Scaling any Modality Model Training to any Accelerators with PyTorch native Training Framework
  ☆297Updated 2 weeks ago
• THUDM / ReST-MCTS
  ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search (NeurIPS 2024)
  ☆616Updated 3 months ago
• InternLM / OREAL
  Exploring the Limit of Outcome Reward for Learning Mathematical Reasoning
  ☆173Updated last month
• feifeibear / long-context-attention
  USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
  ☆477Updated this week
• HarderThenHarder / RLLoggingBoard
  A visuailzation tool to make deep understaning and easier debugging for RLHF training.
  ☆187Updated 2 months ago
• wjn1996 / Awesome-LLM-Reasoning-Openai-o1-Survey
  The related works and background techniques about Openai o1
  ☆221Updated 3 months ago
• ByteDance-Seed / ByteCheckpoint
  ByteCheckpoint: An Unified Checkpointing Library for LFMs
  ☆197Updated 3 weeks ago
• OpenBMB / InfiniteBench
  Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718
  ☆319Updated 7 months ago
• FMInference / H2O
  [NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.
  ☆438Updated 8 months ago
• GAIR-NLP / LIMR
  ☆187Updated 2 months ago
• eddycmu / demystify-long-cot
  ☆283Updated last month
• MARIO-Math-Reasoning / Super_MARIO
  ☆326Updated 2 months ago
• huggingface / Math-Verify
  ☆647Updated 3 weeks ago
• ZubinGou / math-evaluation-harness
  A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨
  ☆203Updated 11 months ago
• liziniu / ReMax
  Code for Paper (ReMax: A Simple, Efficient and Effective Reinforcement Learning Method for Aligning Large Language Models)
  ☆181Updated last year
• YuxiXie / MCTS-DPO
  This is the repository that contains the source code for the Self-Evaluation Guided MCTS for online DPO.
  ☆303Updated 8 months ago
• OFA-Sys / gsm8k-ScRel
  Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models
  ☆256Updated 7 months ago
• PRIME-RL / ImplicitPRM
  Repo of paper "Free Process Rewards without Process Labels"
  ☆143Updated last month
• zhuzilin / ring-flash-attention
  Ring attention implementation with flash attention
  ☆743Updated 2 weeks ago
• Strivin0311 / long-llms-learning
  A repository sharing the literatures about long-context large language models, including the methodologies and the evaluation benchmarks
  ☆260Updated 8 months ago
• ByteDance-Seed / Seed-Thinking-v1.5
  ☆698Updated this week
• hemingkx / Awesome-Efficient-Reasoning
  Paper list for Efficient Reasoning.
  ☆403Updated this week
• cmu-l3 / l1
  L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning
  ☆191Updated last month
• InternLM / InternEvo
  InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencie…
  ☆380Updated last week
• CJReinforce / PURE
  Official code for the paper, "Stop Summation: Min-Form Credit Assignment Is All Process Reward Model Needs for Reasoning"
  ☆107Updated this week
• dvlab-research / Step-DPO
  Implementation for "Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs"
  ☆363Updated 3 months ago
• NVlabs / COAT
  [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training
  ☆184Updated last week