Alternatives and similar repositories for RLPHF

Users that are interested in RLPHF are comparing it to the libraries listed below

• RLHFlow / Directional-Preference-Alignment
  Directional Preference Alignment
  ☆59Updated 11 months ago
• chujiezheng / LLM-Extrapolation
  Official repository for ACL 2025 paper "Model Extrapolation Expedites Alignment"
  ☆75Updated 3 months ago
• Edward-Sun / easy-to-hard
  Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision
  ☆123Updated last year
• haozheji / exact-optimization
  ICML 2024 - Official Repository for EXO: Towards Efficient Exact Optimization of Language Model Alignment
  ☆58Updated last year
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆179Updated 4 months ago
• sotopia-lab / sotopia-pi
  Sotopia-π: Interactive Learning of Socially Intelligent Language Agents (ACL 2024)
  ☆77Updated last year
• hbin0701 / Self-Explore
  [𝐄𝐌𝐍𝐋𝐏 𝐅𝐢𝐧𝐝𝐢𝐧𝐠𝐬 𝟐𝟎𝟐𝟒 & 𝐀𝐂𝐋 𝟐𝟎𝟐𝟒 𝐍𝐋𝐑𝐒𝐄 𝐎𝐫𝐚𝐥] 𝘌𝘯𝘩𝘢𝘯𝘤𝘪𝘯𝘨 𝘔𝘢𝘵𝘩𝘦𝘮𝘢𝘵𝘪𝘤𝘢𝘭 𝘙𝘦𝘢𝘴𝘰𝘯𝘪𝘯…
  ☆52Updated last year
• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆165Updated 4 months ago
• FreedomIntelligence / OVM
  ☆68Updated last year
• RUCAIBox / RLMEC
  The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"
  ☆38Updated last year
• roeehendel / icl_task_vectors
  ☆97Updated last year
• facebookresearch / RLCD
  Reproduction of "RLCD Reinforcement Learning from Contrast Distillation for Language Model Alignment
  ☆69Updated 2 years ago
• icip-cas / Verifier-Engineering
  Search, Verify and Feedback: Towards Next Generation Post-training Paradigm of Foundation Models via Verifier Engineering
  ☆61Updated 9 months ago
• YuxiXie / SelfEval-Guided-Decoding
  ☆100Updated last year
• mukhal / GRACE
  [EMNLP '23] Discriminator-Guided Chain-of-Thought Reasoning
  ☆49Updated 11 months ago
• zankner / CLoud
  Critique-out-Loud Reward Models
  ☆70Updated 10 months ago
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆63Updated last year
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated last year
• alisawuffles / proxy-tuning
  Code associated with Tuning Language Models by Proxy (Liu et al., 2024)
  ☆118Updated last year
• GAIR-NLP / ReasonEval
  [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy
  ☆69Updated 9 months ago
• Shentao-YANG / Preference_Grounded_Guidance
  Source codes for "Preference-grounded Token-level Guidance for Language Model Fine-tuning" (NeurIPS 2023).
  ☆16Updated 8 months ago
• deeplearning-wisc / args
  ☆44Updated last year
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆116Updated last year
• PrasannS / rlhf-length-biases
  ☆27Updated last year
• genrm-star / genrm-critiques
  GenRM-CoT: Data release for verification rationales
  ☆65Updated 10 months ago
• edenbiran / RippleEdits
  Evaluating the Ripple Effects of Knowledge Editing in Language Models
  ☆56Updated last year
• architsharma97 / dpo-rlaif
  ☆100Updated last year
• da03 / implicit_chain_of_thought
  ☆135Updated 10 months ago
• facebookresearch / rlfh-gen-div
  This is code for most of the experiments in the paper Understanding the Effects of RLHF on LLM Generalisation and Diversity
  ☆45Updated last year
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆122Updated 9 months ago