Alternatives and similar repositories for R1

Users that are interested in R1 are comparing it to the libraries listed below

• princeton-nlp / QuRating
  [ICML 2024] Selecting High-Quality Data for Training Language Models
  ☆196Updated last week
• TianHongZXY / RLVR-Decomposed
  [NeurIPS 2025] Implementation for the paper "The Surprising Effectiveness of Negative Reinforcement in LLM Reasoning"
  ☆138Updated last month
• hahahawu / Long-to-Short-via-Model-Merging
  Model merging is a highly efficient approach for long-to-short reasoning.
  ☆92Updated 2 months ago
• lancopku / label-words-are-anchors
  Repository for Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning
  ☆168Updated last year
• SihengLi99 / LLM-Honesty-Survey
  [2025-TMLR] A Survey on the Honesty of Large Language Models
  ☆63Updated last year
• RenShuhuai-Andy / my-tools
  my commonly-used tools
  ☆63Updated 11 months ago
• October2001 / ProLong
  [ACL 2024 (Oral)] A Prospector of Long-Dependency Data for Large Language Models
  ☆58Updated last year
• iie-ycx / DEER
  This is the repository of DEER, a Dynamic Early Exit in Reasoning method for Large Reasoning Language Models.
  ☆177Updated 5 months ago
• sail-sg / sdft
  [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".
  ☆138Updated last year
• tianyi-lab / Superfiltering
  [ACL'24] Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning
  ☆184Updated 5 months ago
• dvlab-research / Mr-Ben
  This is the repo for our paper "Mr-Ben: A Comprehensive Meta-Reasoning Benchmark for Large Language Models"
  ☆52Updated last year
• OpenBMB / RLPR
  Extrapolating RLVR to General Domains without Verifiers
  ☆184Updated 4 months ago
• hkust-nlp / Laser
  Laser: Learn to Reason Efficiently with Adaptive Length-based Reward Shaping
  ☆61Updated 6 months ago
• xufangzhi / ENVISIONS
  [ACL 2025] A Neural-Symbolic Self-Training Framework
  ☆117Updated 6 months ago
• namespace-Pt / UltraGist
  ☆18Updated last year
• NiuTrans / Vision-LLM-Alignment
  This repository contains the code for SFT, RLHF, and DPO, designed for vision-based LLMs, including the LLaVA models and the LLaMA-3.2-vi…
  ☆117Updated 6 months ago
• Bolin97 / awesome-instruction-selector
  Paper list and datasets for the paper: A Survey on Data Selection for LLM Instruction Tuning
  ☆47Updated last year
• QingyangZhang / Label-Free-RLVR
  ☆292Updated 5 months ago
• sail-sg / regmix
  [ICLR 2025] 🧬 RegMix: Data Mixture as Regression for Language Model Pre-training (Spotlight)
  ☆181Updated 10 months ago
• OrangeInSouth / DeePEn
  A method of ensemble learning for heterogeneous large language models.
  ☆64Updated last year
• OpenMOSS / Say-I-Dont-Know
  [ICML'2024] Can AI Assistants Know What They Don't Know?
  ☆85Updated last year
• sail-sg / CPO
  [NeurIPS 2024] The official implementation of paper: Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs.
  ☆134Updated 9 months ago
• InfiMM / Awesome-Multimodal-LLM-for-Math-STEM
  Paper collections of multi-modal LLM for Math/STEM/Code.
  ☆131Updated last month
• SparkJiao / dpo-trajectory-reasoning
  [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".
  ☆83Updated 11 months ago
• ssmisya / PRMBench
  [ACL' 25] The official code repository for PRMBench: A Fine-grained and Challenging Benchmark for Process-Level Reward Models.
  ☆85Updated 10 months ago
• bobxwu / learning-from-rewards-llm-papers
  A comrephensive collection of learning from rewards in the post-training and test-time scaling of LLMs, with a focus on both reward model…
  ☆60Updated 6 months ago
• X-PLUG / mPLUG-HalOwl
  mPLUG-HalOwl: Multimodal Hallucination Evaluation and Mitigating
  ☆98Updated last year
• OpenSparseLLMs / LLaMA-MoE-v2
  🚀 LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training
  ☆89Updated last year
• hkust-nlp / mstar
  [ICML 2025] M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning
  ☆69Updated 5 months ago
• princeton-nlp / CharXiv
  [NeurIPS 2024] CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs
  ☆135Updated 7 months ago