Alternatives and similar repositories for S2R

Users that are interested in S2R are comparing it to the libraries listed below

• CMU-AIRe / MRT
  Research Code for preprint "Optimizing Test-Time Compute via Meta Reinforcement Finetuning".
  ☆98Updated 4 months ago
• WooooDyy / MathCritique
  Implementation for the research paper "Enhancing LLM Reasoning via Critique Models with Test-Time and Training-Time Supervision".
  ☆55Updated 7 months ago
• RyanLiu112 / GenPRM
  Official codebase for "GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning".
  ☆78Updated last month
• sail-sg / CPO
  [NeurIPS 2024] The official implementation of paper: Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs.
  ☆124Updated 3 months ago
• PRIME-RL / ImplicitPRM
  Repo of paper "Free Process Rewards without Process Labels"
  ☆154Updated 4 months ago
• THUDM / T1
  RL Scaling and Test-Time Scaling (ICML'25)
  ☆108Updated 5 months ago
• HKUNLP / critic-rl
  [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning
  ☆102Updated 2 months ago
• rookie-joe / AutoPSV
  ☆46Updated 8 months ago
• YangLing0818 / SuperCorrect-llm
  [ICLR 2025] SuperCorrect: Advancing Small LLM Reasoning with Thought Template Distillation and Self-Correction
  ☆74Updated 3 months ago
• ruixin31 / Spurious_Rewards
  ☆318Updated last month
• GAIR-NLP / OctoThinker
  Revisiting Mid-training in the Era of Reinforcement Learning Scaling
  ☆137Updated last week
• zitian-gao / SC-MCTS
  Interpretable Contrastive Monte Carlo Tree Search Reasoning
  ☆49Updated 8 months ago
• PRIME-RL / Entropy-Mechanism-of-RL
  The Entropy Mechanism of Reinforcement Learning for Large Language Model Reasoning.
  ☆237Updated 2 weeks ago
• rhyang2021 / ARIA
  Source code for our paper: "ARIA: Training Language Agents with Intention-Driven Reward Aggregation".
  ☆18Updated 3 weeks ago
• icip-cas / Verifier-Engineering
  Search, Verify and Feedback: Towards Next Generation Post-training Paradigm of Foundation Models via Verifier Engineering
  ☆60Updated 7 months ago
• sanowl / Self-Correcting-LLM--Reinforcement-Learning-
  This my attempt to create Self-Correcting-LLM based on the paper Training Language Models to Self-Correct via Reinforcement Learning by g…
  ☆35Updated this week
• hkust-nlp / mstar
  [ICML 2025] M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning
  ☆61Updated 6 months ago
• bethgelab / sober-reasoning
  A Sober Look at Language Model Reasoning
  ☆75Updated 3 weeks ago
• Vance0124 / Token-level-Direct-Preference-Optimization
  Reference implementation for Token-level Direct Preference Optimization(TDPO)
  ☆141Updated 5 months ago
• limenlp / verl
  AdaRFT: Efficient Reinforcement Finetuning via Adaptive Curriculum Learning
  ☆38Updated last month
• THU-KEG / RM-Bench
  [ICLR 25 Oral] RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Style
  ☆55Updated 2 weeks ago
• kanishkg / cognitive-behaviors
  ☆199Updated 3 months ago
• IAAR-Shanghai / xVerify
  xVerify: Efficient Answer Verifier for Reasoning Model Evaluations
  ☆119Updated 2 months ago
• RM-R1-UIUC / RM-R1
  RM-R1: Unleashing the Reasoning Potential of Reward Models
  ☆113Updated 2 weeks ago
• TIGER-AI-Lab / verl-tool
  A version of verl to support tool use
  ☆292Updated this week
• KbsdJames / Omni-MATH
  The official repository of the Omni-MATH benchmark.
  ☆85Updated 6 months ago
• hkust-nlp / B-STaR
  B-STAR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners
  ☆82Updated last month
• ryoungj / BoLT
  Code for "Reasoning to Learn from Latent Thoughts"
  ☆112Updated 3 months ago
• LightChen233 / reasoning-boundary
  ☆64Updated 3 weeks ago
• GAIR-NLP / LIMR
  ☆205Updated 4 months ago