Alternatives and similar repositories for CARP

Users that are interested in CARP are comparing it to the libraries listed below

• CriticBench / CriticBench
  [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning
  ☆27Updated last year
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆62Updated last year
• OpenMOSS / Say-I-Dont-Know
  [ICML'2024] Can AI Assistants Know What They Don't Know?
  ☆83Updated last year
• GAIR-NLP / ReasonEval
  [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy
  ☆69Updated 8 months ago
• FreedomIntelligence / OVM
  ☆68Updated last year
• RUCAIBox / JiuZhang3.0
  The code and data for the paper JiuZhang3.0
  ☆48Updated last year
• SihengLi99 / LLM-Honesty-Survey
  [2025-TMLR] A Survey on the Honesty of Large Language Models
  ☆58Updated 8 months ago
• lfy79001 / S3Eval
  [NAACL 2024] A Synthetic, Scalable and Systematic Evaluation Suite for Large Language Models
  ☆33Updated last year
• GAIR-NLP / BeHonest
  BeHonest: Benchmarking Honesty in Large Language Models
  ☆34Updated last year
• OhadRubin / EPR
  ☆63Updated 2 years ago
• TobiasLee / VEC
  Visual and Embodied Concepts evaluation benchmark
  ☆21Updated last year
• FranxYao / FlanT5-CoT-Specialization
  Implementation of ICML 23 Paper: Specializing Smaller Language Models towards Multi-Step Reasoning.
  ☆132Updated 2 years ago
• ChengpengLi1003 / DotaMath
  ☆30Updated 8 months ago
• Yifan-Song793 / GoodBadGreedy
  The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism
  ☆30Updated last year
• Spico197 / MoE-SFT
  🍼 Official implementation of Dynamic Data Mixing Maximizes Instruction Tuning for Mixture-of-Experts
  ☆40Updated 10 months ago
• hanningzhang / prm
  ☆17Updated 9 months ago
• YuxiXie / SelfEval-Guided-Decoding
  ☆100Updated last year
• October2001 / ProLong
  [ACL 2024 (Oral)] A Prospector of Long-Dependency Data for Large Language Models
  ☆56Updated last year
• siyuyuan / coscript
  Resources for our ACL 2023 paper: Distilling Script Knowledge from Large Language Models for Constrained Language Planning
  ☆36Updated 2 years ago
• Re-Align / AlignTDS
  Analyzing LLM Alignment via Token distribution shift
  ☆16Updated last year
• GAIR-NLP / alignment-for-honesty
  ☆75Updated last year
• dvlab-research / Mr-Ben
  This is the repo for our paper "Mr-Ben: A Comprehensive Meta-Reasoning Benchmark for Large Language Models"
  ☆50Updated 9 months ago
• SparkJiao / dpo-trajectory-reasoning
  [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".
  ☆80Updated 7 months ago
• GAIR-NLP / weak-to-strong-reasoning
  ☆59Updated 11 months ago
• BenfengXu / KNNPrompting
  Released code for our ICLR23 paper.
  ☆65Updated 2 years ago
• HillZhang1999 / ICD
  Code & Data for our Paper "Alleviating Hallucinations of Large Language Models through Induced Hallucinations"
  ☆69Updated last year
• sail-sg / symbolic-instruction-tuning
  The official repository for the paper "From Zero to Hero: Examining the Power of Symbolic Tasks in Instruction Tuning".
  ☆66Updated 2 years ago
• dqxiu / PLMs-with-Knowledge
  ☆16Updated 3 years ago
• conceptmath / conceptmath
  [ACL 2024 Findings] The official repo for "ConceptMath: A Bilingual Concept-wise Benchmark for Measuring Mathematical Reasoning of Large …
  ☆24Updated last year
• xufangzhi / ENVISIONS
  [ACL 2025] A Neural-Symbolic Self-Training Framework
  ☆111Updated 2 months ago