Alternatives and similar repositories for SPAG

Users that are interested in SPAG are comparing it to the libraries listed below

• IBM / SALMON
  Self-Alignment with Principle-Following Reward Models
  ☆169Updated 3 months ago
• WindyLee0822 / Process_Q_Model
  official implementation of paper "Process Reward Model with Q-value Rankings"
  ☆65Updated 10 months ago
• architsharma97 / dpo-rlaif
  ☆100Updated last year
• Edward-Sun / easy-to-hard
  Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision
  ☆125Updated last year
• ezelikman / STaR
  Code for STaR: Bootstrapping Reasoning With Reasoning (NeurIPS 2022)
  ☆217Updated 2 years ago
• hkust-nlp / llm-compression-intelligence
  Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]
  ☆146Updated last year
• TIGER-AI-Lab / CritiqueFineTuning
  Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate" [COLM 2025]
  ☆180Updated 5 months ago
• google-deepmind / bbeh
  ☆108Updated 7 months ago
• waterhorse1 / LLM_Tree_Search
  (ICML 2024) Alphazero-like Tree-Search can guide large language model decoding and training
  ☆283Updated last year
• da03 / implicit_chain_of_thought
  ☆139Updated last year
• openai / safety-rbr-code-and-data
  Code and example data for the paper: Rule Based Rewards for Language Model Safety
  ☆203Updated last year
• vwxyzjn / summarize_from_feedback_details
  ☆160Updated last year
• jwhj / OREO
  ☆116Updated 11 months ago
• THUDM / T1
  RL Scaling and Test-Time Scaling (ICML'25)
  ☆112Updated 11 months ago
• WooooDyy / LLM-Reverse-Curriculum-RL
  Implementation of the ICML 2024 paper "Training Large Language Models for Reasoning through Reverse Curriculum Reinforcement Learning" pr…
  ☆114Updated last year
• Linear95 / APO
  Code for ACL2024 paper - Adversarial Preference Optimization (APO).
  ☆56Updated last year
• da03 / Internalize_CoT_Step_by_Step
  ☆200Updated 8 months ago
• Berkeley-NLP / Agent-Eval-Refine
  Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]
  ☆147Updated last year
• Yu-Fangxu / FoR
  [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples
  ☆113Updated 5 months ago
• McGill-NLP / VinePPO
  Code for the paper "VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment"
  ☆183Updated 7 months ago
• liziniu / ReMax
  Code for Paper (ReMax: A Simple, Efficient and Effective Reinforcement Learning Method for Aligning Large Language Models)
  ☆199Updated 2 years ago
• YifeiZhou02 / ArCHer
  Research Code for "ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL"
  ☆199Updated 8 months ago
• waterhorse1 / Natural-language-RL
  Natural Language Reinforcement Learning
  ☆101Updated 5 months ago
• chujiezheng / LLM-Extrapolation
  Official repository for ACL 2025 paper "Model Extrapolation Expedites Alignment"
  ☆76Updated 7 months ago
• kyegomez / Lets-Verify-Step-by-Step
  "Improving Mathematical Reasoning with Process Supervision" by OPENAI
  ☆114Updated 2 months ago
• SalesforceAIResearch / LaTRO
  ☆125Updated 10 months ago
• joeljang / RLPHF
  Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging
  ☆115Updated 2 years ago
• princeton-nlp / USACO
  Can Language Models Solve Olympiad Programming?
  ☆124Updated 11 months ago
• hkust-nlp / B-STaR
  B-STAR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners
  ☆86Updated 7 months ago
• PRIME-RL / ImplicitPRM
  Repo of paper "Free Process Rewards without Process Labels"
  ☆168Updated 9 months ago