Alternatives and similar repositories for Self-Evolving-Benchmark

Users that are interested in Self-Evolving-Benchmark are comparing it to the libraries listed below

• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆51Updated 2 months ago
• wwxu21 / CUT
  Source code of "Reasons to Reject? Aligning Language Models with Judgments"
  ☆58Updated last year
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆42Updated last year
• Re-Align / just-eval
  A simple GPT-based evaluation tool for multi-aspect, interpretable assessment of LLMs.
  ☆85Updated last year
• lfy79001 / S3Eval
  [NAACL 2024] A Synthetic, Scalable and Systematic Evaluation Suite for Large Language Models
  ☆32Updated last year
• zitian-gao / SC-MCTS
  Interpretable Contrastive Monte Carlo Tree Search Reasoning
  ☆48Updated 9 months ago
• yyDing1 / ScaleQuest
  [ACL-25] We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.
  ☆63Updated 9 months ago
• OpenMOSS / Say-I-Dont-Know
  [ICML'2024] Can AI Assistants Know What They Don't Know?
  ☆82Updated last year
• Reason-Wang / NAT
  [NAACL 2025] The official implementation of paper "Learning From Failure: Integrating Negative Examples when Fine-tuning Large Language M…
  ☆26Updated last year
• WHGTyen / BIG-Bench-Mistake
  A dataset of LLM-generated chain-of-thought steps annotated with mistake location.
  ☆81Updated last year
• ZHZisZZ / weak-to-strong-search
  [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
  ☆62Updated 8 months ago
• YuxiXie / SelfEval-Guided-Decoding
  ☆100Updated last year
• lifan-yuan / CRAFT
  Code for ICLR 2024 paper "CRAFT: Customizing LLMs by Creating and Retrieving from Specialized Toolsets"
  ☆57Updated last year
• TianHongZXY / CoRe
  [ACL 2023] Solving Math Word Problems via Cooperative Reasoning induced Language Models (LLMs + MCTS + Self-Improvement)
  ☆50Updated last year
• Junjie-Ye / ToolEyes
  [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios
  ☆68Updated 2 months ago
• thu-coai / ComplexBench
  Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)
  ☆91Updated 5 months ago
• WeiminXiong / IPR
  Watch Every Step! LLM Agent Learning via Iterative Step-level Process Refinement (EMNLP 2024 Main Conference)
  ☆61Updated 9 months ago
• WindyLee0822 / Process_Q_Model
  official implementation of paper "Process Reward Model with Q-value Rankings"
  ☆60Updated 6 months ago
• RUCAIBox / RLMEC
  The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"
  ☆38Updated last year
• yihedeng9 / DuoGuard
  DuoGuard: A Two-Player RL-Driven Framework for Multilingual LLM Guardrails
  ☆26Updated 5 months ago
• yegcjs / mixinglaws
  ☆104Updated 3 weeks ago
• RUCAIBox / BAMBOO
  ☆35Updated last year
• GAIR-NLP / OlympicArena
  [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI
  ☆102Updated 5 months ago
• JoeYing1019 / UltraTool
  [ACL2024] Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarios
  ☆57Updated last week
• yinzhangyue / SelfAware
  Do Large Language Models Know What They Don’t Know?
  ☆99Updated 9 months ago
• SparkJiao / dpo-trajectory-reasoning
  [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".
  ☆80Updated 6 months ago
• GAIR-NLP / MetaCritique
  Evaluate the Quality of Critique
  ☆36Updated last year
• chujiezheng / LLM-Extrapolation
  Official repository for ACL 2025 paper "Model Extrapolation Expedites Alignment"
  ☆75Updated 2 months ago
• zjunlp / TRICE
  [NAACL 2024] Making Language Models Better Tool Learners with Execution Feedback
  ☆42Updated last year
• JayZhang42 / SLED
  SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433
  ☆28Updated 8 months ago