Alternatives and similar repositories for VersaPRM

Users that are interested in VersaPRM are comparing it to the libraries listed below

• chujiezheng / LLM-Extrapolation
  Official repository for ACL 2025 paper "Model Extrapolation Expedites Alignment"
  ☆76Updated 6 months ago
• hbin0701 / Self-Explore
  [𝐄𝐌𝐍𝐋𝐏 𝐅𝐢𝐧𝐝𝐢𝐧𝐠𝐬 𝟐𝟎𝟐𝟒 & 𝐀𝐂𝐋 𝟐𝟎𝟐𝟒 𝐍𝐋𝐑𝐒𝐄 𝐎𝐫𝐚𝐥] 𝘌𝘯𝘩𝘢𝘯𝘤𝘪𝘯𝘨 𝘔𝘢𝘵𝘩𝘦𝘮𝘢𝘵𝘪𝘤𝘢𝘭 𝘙𝘦𝘢𝘴𝘰𝘯𝘪𝘯…
  ☆51Updated last year
• joeljang / RLPHF
  Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging
  ☆113Updated 2 years ago
• SalesforceAIResearch / GemFilter
  ☆85Updated last month
• facebookresearch / llm-cross-capabilities
  Official implementation for "Law of the Weakest Link: Cross capabilities of Large Language Models"
  ☆43Updated last year
• kaistAI / Janus
  [NeurIPS 2024] Train LLMs with diverse system messages reflecting individualized preferences to generalize to unseen system messages
  ☆52Updated 4 months ago
• SihengLi99 / SEALONG
  Large Language Models Can Self-Improve in Long-context Reasoning
  ☆73Updated last year
• fangyuan-ksgk / CoT-Reasoning-without-Prompting
  Unofficial Implementation of Chain-of-Thought Reasoning Without Prompting
  ☆34Updated last year
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆45Updated 7 months ago
• GAIR-NLP / weak-to-strong-reasoning
  ☆58Updated last year
• RLHFlow / Directional-Preference-Alignment
  Directional Preference Alignment
  ☆58Updated last year
• DAMO-NLP-SG / LongPO
  [ICLR 2025] LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization
  ☆43Updated 9 months ago
• chtmp223 / suri
  Suri: Multi-constraint instruction following for long-form text generation (EMNLP’24)
  ☆27Updated 2 months ago
• HKUNLP / critic-rl
  [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning
  ☆118Updated 7 months ago
• GAIR-NLP / MoPS
  [ACL 2024] Code for "MoPS: Modular Story Premise Synthesis for Open-Ended Automatic Story Generation"
  ☆40Updated last year
• xufangzhi / phi-Decoding
  [ACL 2025] An inference-time decoding strategy with adaptive foresight sampling
  ☆106Updated 6 months ago
• RLHFlow / RAFT
  This is an official implementation of the Reward rAnked Fine-Tuning Algorithm (RAFT), also known as iterative best-of-n fine-tuning or re…
  ☆37Updated last year
• mukhal / GRACE
  [EMNLP '23] Discriminator-Guided Chain-of-Thought Reasoning
  ☆49Updated last year
• hkust-nlp / B-STaR
  B-STAR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners
  ☆86Updated 6 months ago
• DRSY / KV_Compression
  [EMNLP 2023]Context Compression for Auto-regressive Transformers with Sentinel Tokens
  ☆25Updated 2 years ago
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆115Updated 10 months ago
• SparkJiao / dpo-trajectory-reasoning
  [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".
  ☆82Updated 10 months ago
• WindyLee0822 / Process_Q_Model
  official implementation of paper "Process Reward Model with Q-value Rankings"
  ☆65Updated 10 months ago
• alinlab / HOMER
  Official implementation of Hierarchical Context Merging: Better Long Context Understanding for Pre-trained LLMs (ICLR 2024).
  ☆43Updated last year
• HKUNLP / STRING
  [ICLR'25] Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"
  ☆78Updated last year
• QingruZhang / PASTA
  PASTA: Post-hoc Attention Steering for LLMs
  ☆130Updated last year
• shenao-zhang / SELM
  The official implementation of Self-Exploring Language Models (SELM)
  ☆63Updated last year
• tongxuluo / prts
  Code and Model for NeurIPS 2024 Spotlight Paper "Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training…
  ☆44Updated last year
• UCSB-NLP-Chang / ThinkPrune
  ☆45Updated 2 months ago
• zhiyuanhubj / LongRecipe
  LongRecipe: Recipe for Efficient Long Context Generalization in Large Language Models
  ☆77Updated last year