Alternatives and similar repositories for ConsisEval

Users that are interested in ConsisEval are comparing it to the libraries listed below

• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆80Updated 9 months ago
• LuLuLuyi / LongHeads
  [EMNLP'24] LongHeads: Multi-Head Attention is Secretly a Long Context Processor
  ☆31Updated last year
• GAIR-NLP / OlympicArena
  [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI
  ☆107Updated 10 months ago
• microsoft / LEMA
  official repo for the paper "Learning From Mistakes Makes LLM Better Reasoner"
  ☆60Updated 2 years ago
• microsoft / EpiCoder
  Implementation for "EpiCoder: Encompassing Diversity and Complexity in Code Generation" (ICML 2025)
  ☆21Updated 8 months ago
• QwenLM / CodeElo
  CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratings
  ☆61Updated 11 months ago
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆43Updated last year
• suu990901 / KlearReasoner
  Klear-Reasoner: Advancing Reasoning Capability via Gradient-Preserving Clipping Policy Optimization
  ☆81Updated last month
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆148Updated last year
• lifan-yuan / CRAFT
  Code for ICLR 2024 paper "CRAFT: Customizing LLMs by Creating and Retrieving from Specialized Toolsets"
  ☆60Updated last year
• GAIR-NLP / MetaCritique
  Evaluate the Quality of Critique
  ☆36Updated last year
• zankner / CLoud
  Critique-out-Loud Reward Models
  ☆73Updated last year
• MobileLLM / ParaThinker
  ☆41Updated 2 months ago
• microsoft / ConstrainedReasoner
  ☆13Updated last year
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated last year
• allenai / IFBench
  ☆98Updated 3 weeks ago
• MasterVito / SwS
  Official Repo for SwS: A Weakness-driven Problem Synthesis Framework in RL for LLM Reasoning
  ☆42Updated 2 months ago
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆53Updated 7 months ago
• texttron / BrowseComp-Plus
  BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agent
  ☆164Updated last month
• icip-cas / Verifier-Engineering
  Search, Verify and Feedback: Towards Next Generation Post-training Paradigm of Foundation Models via Verifier Engineering
  ☆63Updated last year
• ScalerLab / JudgeBench
  ☆107Updated last year
• test-time-interaction / TTI
  ☆72Updated 7 months ago
• QwenLM / ProcessBench
  Official repository for ACL 2025 paper "ProcessBench: Identifying Process Errors in Mathematical Reasoning"
  ☆183Updated 8 months ago
• GAIR-NLP / weak-to-strong-reasoning
  ☆58Updated last year
• Zhiyuan-Zeng / EvalTree
  [COLM 2025] EvalTree: Profiling Language Model Weaknesses via Hierarchical Capability Trees
  ☆31Updated 6 months ago
• AlexCuadron / ThinkingAgent
  Systematic evaluation framework that automatically rates overthinking behavior in large language models.
  ☆96Updated 8 months ago
• GAIR-NLP / OctoThinker
  Revisiting Mid-training in the Era of Reinforcement Learning Scaling
  ☆182Updated 6 months ago
• koalazf99 / nanoverl
  Collections of RLxLM experiments using minimal codes
  ☆14Updated 11 months ago
• MLE-Dojo / MLE-Dojo
  ☆89Updated 3 months ago
• HKUNLP / critic-rl
  [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning
  ☆120Updated 8 months ago