Alternatives and similar repositories for PENCIL

Users that are interested in PENCIL are comparing it to the libraries listed below

• Parallel-Reasoning / APR
  [COLM 2025] Code for Paper: Learning Adaptive Parallel Reasoning with Language Models
  ☆138Updated last month
• ryoungj / BoLT
  Code for "Reasoning to Learn from Latent Thoughts"
  ☆124Updated 10 months ago
• Gen-Verse / CURE
  [NeurIPS 2025 Spotlight] Co-Evolving LLM Coder and Unit Tester via Reinforcement Learning
  ☆148Updated 4 months ago
• THUDM / T1
  RL Scaling and Test-Time Scaling (ICML'25)
  ☆112Updated last year
• Interplay-LM-Reasoning / Interplay-LM-Reasoning
  ☆130Updated this week
• GAIR-NLP / OctoThinker
  Revisiting Mid-training in the Era of Reinforcement Learning Scaling
  ☆182Updated 6 months ago
• HKUNLP / critic-rl
  [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning
  ☆120Updated 8 months ago
• LAMDASZ-ML / Self-Backtracking
  ☆50Updated 11 months ago
• hkust-nlp / dart-math
  [NeurIPS'24] Official code for *🎯DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving*
  ☆120Updated last year
• MiniMax-AI / SynLogic
  [NeurIPS 2025] The official repo of SynLogic: Synthesizing Verifiable Reasoning Data at Scale for Learning Logical Reasoning and Beyond
  ☆190Updated 6 months ago
• jwhj / OREO
  ☆117Updated last year
• zhenyuhe00 / SWE-Swiss
  SWE-Swiss: A Multi-Task Fine-Tuning and RL Recipe for High-Performance Issue Resolution
  ☆102Updated 4 months ago
• WindyLee0822 / Process_Q_Model
  official implementation of paper "Process Reward Model with Q-value Rankings"
  ☆65Updated 11 months ago
• Yu-Fangxu / FoR
  [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples
  ☆114Updated 6 months ago
• efficientscaling / Z1
  [EMNLP'25 Industry] Repo for "Z1: Efficient Test-time Scaling with Code"
  ☆68Updated 9 months ago
• ruixin31 / Spurious_Rewards
  ☆348Updated 6 months ago
• zitian-gao / SC-MCTS
  Interpretable Contrastive Monte Carlo Tree Search Reasoning
  ☆50Updated last year
• CMU-AIRe / MRT
  Research Code for preprint "Optimizing Test-Time Compute via Meta Reinforcement Finetuning".
  ☆116Updated 5 months ago
• R2E-Gym / R2E-Gym
  [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents
  ☆229Updated 6 months ago
• mukhal / ThinkPRM
  Process Reward Models That Think
  ☆77Updated 2 months ago
• Infini-AI-Lab / gsm_infinite
  ☆63Updated 7 months ago
• PRIME-RL / ImplicitPRM
  Repo of paper "Free Process Rewards without Process Labels"
  ☆168Updated 10 months ago
• Infini-AI-Lab / Multiverse
  ☆110Updated 4 months ago
• test-time-interaction / TTI
  ☆72Updated 7 months ago
• GuanghaoYe / Emergence-of-Thinking
  ☆53Updated 11 months ago
• facebookresearch / sweet_rl
  Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks
  ☆255Updated 8 months ago
• mathllm / MathCoder2
  ☆71Updated last year
• waterhorse1 / Natural-language-RL
  Natural Language Reinforcement Learning
  ☆101Updated 5 months ago
• GAIR-NLP / AIME-Preview
  ☆80Updated 10 months ago
• ScalingIntelligence / large_language_monkeys
  ☆112Updated last year