Alternatives and similar repositories for S3Eval

Users that are interested in S3Eval are comparing it to the libraries listed below

• CriticBench / CriticBench
  [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning
  ☆28Updated last year
• Yifan-Song793 / GoodBadGreedy
  The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism
  ☆30Updated last year
• OpenMOSS / Say-I-Dont-Know
  [ICML'2024] Can AI Assistants Know What They Don't Know?
  ☆85Updated last year
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆51Updated 6 months ago
• ZHZisZZ / weak-to-strong-search
  [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
  ☆64Updated last year
• ChengpengLi1003 / DotaMath
  ☆30Updated last year
• GAIR-NLP / BeHonest
  BeHonest: Benchmarking Honesty in Large Language Models
  ☆34Updated last year
• wwxu21 / CUT
  Source code of "Reasons to Reject? Aligning Language Models with Judgments"
  ☆58Updated last year
• GAIR-NLP / weak-to-strong-reasoning
  ☆58Updated last year
• RUCAIBox / JiuZhang3.0
  The code and data for the paper JiuZhang3.0
  ☆49Updated last year
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆64Updated last year
• Spico197 / MoE-SFT
  🍼 Official implementation of Dynamic Data Mixing Maximizes Instruction Tuning for Mixture-of-Experts
  ☆41Updated last year
• HillZhang1999 / ICD
  Code & Data for our Paper "Alleviating Hallucinations of Large Language Models through Induced Hallucinations"
  ☆69Updated last year
• SihengLi99 / LLM-Honesty-Survey
  [2025-TMLR] A Survey on the Honesty of Large Language Models
  ☆64Updated last year
• rookie-joe / AutoPSV
  ☆51Updated last year
• yiqingxyq / RepoST
  Code for "[COLM'25] RepoST: Scalable Repository-Level Coding Environment Construction with Sandbox Testing"
  ☆22Updated 9 months ago
• dvlab-research / Mr-Ben
  This is the repo for our paper "Mr-Ben: A Comprehensive Meta-Reasoning Benchmark for Large Language Models"
  ☆52Updated last year
• Zce1112zslx / IKE
  ☆41Updated 2 years ago
• GAIR-NLP / alignment-for-honesty
  ☆77Updated last year
• TingchenFu / MathIF
  instruction-following benchmark for large reasoning models
  ☆44Updated 4 months ago
• SparkJiao / dpo-trajectory-reasoning
  [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".
  ☆83Updated 11 months ago
• RUCAIBox / RLMEC
  The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"
  ☆39Updated last year
• TobiasLee / VEC
  Visual and Embodied Concepts evaluation benchmark
  ☆21Updated 2 years ago
• dqxiu / KAssess
  ☆14Updated 2 years ago
• hanxuhu / SeqIns
  The repository of the project "Fine-tuning Large Language Models with Sequential Instructions", code base comes from open-instruct and LA…
  ☆30Updated last year
• jinzhuoran / RAG-RewardBench
  RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment
  ☆16Updated last year
• GAIR-NLP / ReasonEval
  [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy
  ☆76Updated 2 months ago
• vickywu1022 / OntoProbe-PLMs
  Repo for outstanding paper@ACL 2023 "Do PLMs Know and Understand Ontological Knowledge?"
  ☆33Updated 2 years ago
• KbsdJames / omni-math-rule
  The rule-based evaluation subset and code implementation of Omni-MATH
  ☆26Updated last year
• KbsdJames / MATH-Minos
  The implementation of paper "LLM Critics Help Catch Bugs in Mathematics: Towards a Better Mathematical Verifier with Natural Language Fee…
  ☆37Updated last year