Alternatives and similar repositories for CREAM

Users that are interested in CREAM are comparing it to the libraries listed below

• RyanLiu112 / GenPRM
  [AAAI 2026] Official codebase for "GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning".
  ☆95Updated 3 months ago
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆91Updated 11 months ago
• zjunlp / LightThinker
  [EMNLP 2025] LightThinker: Thinking Step-by-Step Compression
  ☆132Updated 9 months ago
• WooooDyy / MathCritique
  Implementation for the research paper "Enhancing LLM Reasoning via Critique Models with Test-Time and Training-Time Supervision".
  ☆55Updated last year
• WangHanLinHenry / SPA-RL-Agent
  Official code for paper "SPA-RL: Reinforcing LLM Agent via Stepwise Progress Attribution"
  ☆62Updated 4 months ago
• TianHongZXY / RLVR-Decomposed
  [NeurIPS 2025] Implementation for the paper "The Surprising Effectiveness of Negative Reinforcement in LLM Reasoning"
  ☆160Updated 3 months ago
• LightChen233 / reasoning-boundary
  ☆70Updated 7 months ago
• RM-R1-UIUC / RM-R1
  RM-R1: Unleashing the Reasoning Potential of Reward Models
  ☆158Updated 7 months ago
• lichengliu03 / unary-feedback
  ☆43Updated 5 months ago
• ssmisya / PRMBench
  [ACL' 25] The official code repository for PRMBench: A Fine-grained and Challenging Benchmark for Process-Level Reward Models.
  ☆88Updated 11 months ago
• THU-KEG / AdaptThink
  ☆178Updated 2 months ago
• THUDM / TreeRL
  TreeRL: LLM Reinforcement Learning with On-Policy Tree Search in ACL'25
  ☆88Updated 7 months ago
• bobxwu / learning-from-rewards-llm-papers
  A comrephensive collection of learning from rewards in the post-training and test-time scaling of LLMs, with a focus on both reward model…
  ☆62Updated 7 months ago
• StarDewXXX / AdaR1
  The official repository of NeurIPS'25 paper "Ada-R1: From Long-Cot to Hybrid-CoT via Bi-Level Adaptive Reasoning Optimization"
  ☆21Updated 2 months ago
• rookie-joe / AutoPSV
  ☆51Updated last year
• MozerWang / AMPO
  [ICLR 2026] Adaptive Social Learning via Mode Policy Optimization for Language Agents
  ☆47Updated this week
• Gen-Verse / GenEnv
  ☆45Updated last month
• lukahhcm / Awesome_Environment_Scaling
  Resources and paper list for 'Scaling Environments for Agents'. This repository accompanies our survey on how environments contribute to …
  ☆58Updated last week
• hahahawu / Long-to-Short-via-Model-Merging
  Model merging is a highly efficient approach for long-to-short reasoning.
  ☆98Updated 3 months ago
• sail-sg / CPO
  [NeurIPS 2024] The official implementation of paper: Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs.
  ☆134Updated 10 months ago
• hkust-nlp / mstar
  [ICML 2025] M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning
  ☆70Updated 6 months ago
• AIFrameResearch / SPO
  Segment Policy Optimization: Effective Segment-Level Credit Assignment in RL for Large Language Models
  ☆45Updated 4 months ago
• YangLing0818 / SuperCorrect-llm
  [ICLR 2025] SuperCorrect: Advancing Small LLM Reasoning with Thought Template Distillation and Self-Correction
  ☆87Updated 10 months ago
• MingyuJ666 / Rope_with_LLM
  [ICML'25] Our study systematically investigates massive values in LLMs' attention mechanisms. First, we observe massive values are concen…
  ☆85Updated 7 months ago
• ChnQ / MI-Peaks
  ☆63Updated 6 months ago
• Zanette-Labs / efficient-reasoning
  ☆74Updated 9 months ago
• zhangxy-2019 / critique-GRPO
  ☆57Updated 4 months ago
• xiaomi-research / colar
  [NeurIPS 2025] Think Silently, Think Fast: Dynamic Latent Compression of LLM Reasoning Chains
  ☆74Updated 6 months ago
• Small-Model-Gap / Small-Model-Learnability-Gap
  ☆20Updated 3 months ago
• RyanLiu112 / Awesome-Process-Reward-Models
  A comprehensive collection of process reward models.
  ☆136Updated 4 months ago