Alternatives and similar repositories for CriticEval

Users that are interested in CriticEval are comparing it to the libraries listed below

• dvlab-research / Mr-Ben
  This is the repo for our paper "Mr-Ben: A Comprehensive Meta-Reasoning Benchmark for Large Language Models"
  ☆50Updated last year
• wwxu21 / CUT
  Source code of "Reasons to Reject? Aligning Language Models with Judgments"
  ☆58Updated last year
• RUCAIBox / JiuZhang3.0
  The code and data for the paper JiuZhang3.0
  ☆49Updated last year
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆51Updated 5 months ago
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆149Updated last year
• chujiezheng / LLM-Extrapolation
  Official repository for ACL 2025 paper "Model Extrapolation Expedites Alignment"
  ☆75Updated 5 months ago
• microsoft / LEMA
  official repo for the paper "Learning From Mistakes Makes LLM Better Reasoner"
  ☆58Updated last year
• SihengLi99 / SEALONG
  Large Language Models Can Self-Improve in Long-context Reasoning
  ☆73Updated 11 months ago
• ZHZisZZ / weak-to-strong-search
  [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
  ☆63Updated 11 months ago
• GAIR-NLP / ReasonEval
  [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy
  ☆76Updated last month
• open-compass / ANAH
  [ACL 2024] ANAH & [NeurIPS 2024] ANAH-v2 & [ICLR 2025] Mask-DPO
  ☆55Updated 6 months ago
• Reason-Wang / NAT
  [NAACL 2025] The official implementation of paper "Learning From Failure: Integrating Negative Examples when Fine-tuning Large Language M…
  ☆29Updated last year
• yyDing1 / ScaleQuest
  [ACL 2025] We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLM…
  ☆68Updated last year
• GAIR-NLP / OlympicArena
  [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI
  ☆108Updated 8 months ago
• open-compass / GPassK
  [ACL 2025] Are Your LLMs Capable of Stable Reasoning?
  ☆31Updated 3 months ago
• starrYYxuan / LeCo
  This the implementation of LeCo
  ☆31Updated 9 months ago
• WHGTyen / BIG-Bench-Mistake
  A dataset of LLM-generated chain-of-thought steps annotated with mistake location.
  ☆82Updated last year
• HKUNLP / critic-rl
  [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning
  ☆115Updated 6 months ago
• hbin0701 / Self-Explore
  [𝐄𝐌𝐍𝐋𝐏 𝐅𝐢𝐧𝐝𝐢𝐧𝐠𝐬 𝟐𝟎𝟐𝟒 & 𝐀𝐂𝐋 𝟐𝟎𝟐𝟒 𝐍𝐋𝐑𝐒𝐄 𝐎𝐫𝐚𝐥] 𝘌𝘯𝘩𝘢𝘯𝘤𝘪𝘯𝘨 𝘔𝘢𝘵𝘩𝘦𝘮𝘢𝘵𝘪𝘤𝘢𝘭 𝘙𝘦𝘢𝘴𝘰𝘯𝘪𝘯…
  ☆51Updated last year
• GAIR-NLP / weak-to-strong-reasoning
  ☆58Updated last year
• RUCAIBox / RLMEC
  The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"
  ☆38Updated last year
• Junjie-Ye / ToolEyes
  [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios
  ☆70Updated 6 months ago
• GAIR-NLP / MetaCritique
  Evaluate the Quality of Critique
  ☆36Updated last year
• tatsu-lab / test_set_contamination
  ☆41Updated 2 years ago
• THUDM / T1
  RL Scaling and Test-Time Scaling (ICML'25)
  ☆112Updated 9 months ago
• princeton-nlp / LLMBar
  [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following
  ☆133Updated last year
• open-compass / MathBench
  [ACL 2024 Findings] MathBench: A Comprehensive Multi-Level Difficulty Mathematics Evaluation Dataset
  ☆109Updated 5 months ago
• meowpass / FollowComplexInstruction
  Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…
  ☆51Updated last year
• chtmp223 / suri
  Suri: Multi-constraint instruction following for long-form text generation (EMNLP’24)
  ☆26Updated last month
• WeiminXiong / IPR
  Watch Every Step! LLM Agent Learning via Iterative Step-level Process Refinement (EMNLP 2024 Main Conference)
  ☆63Updated last year